-- Logs begin at Thu 2021-12-16 17:14:31 UTC, end at Thu 2021-12-16 18:22:19 UTC. -- Dec 16 17:46:56.132273 dv-cinder-819200-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 17:46:56.142142 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 17:46:56 2021] *** Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: nodename: dv-cinder-819200-2-iscsi Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: machine: x86_64 Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: clock source: unix Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: pcre jit disabled Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: detected number of CPU cores: 4 Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: current working directory: / Dec 16 17:46:56.144759 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: detected binary path: /usr/bin/uwsgi-core Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: your processes number limit is 47680 Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: your memory page size is 4096 bytes Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: detected max file descriptor number: 2048 Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: lock engine: pthread robust mutexes Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: thunder lock: enabled Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 17:46:56.145491 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 17:46:56.189820 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: Python main interpreter initialized at 0x55ef12af39c0 Dec 16 17:46:56.189820 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: python threads support enabled Dec 16 17:46:56.189820 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: your server socket listen backlog is limited to 100 connections Dec 16 17:46:56.189820 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: your mercy for graceful operations on workers is 90 seconds Dec 16 17:46:56.190199 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 17:46:56.190199 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: *** Operational MODE: preforking *** Dec 16 17:46:56.190478 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: *** uWSGI is running in multiple interpreter mode *** Dec 16 17:46:56.190478 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: spawned uWSGI master process (pid: 101725) Dec 16 17:46:56.190737 dv-cinder-819200-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 17:46:56.191296 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: spawned uWSGI worker 1 (pid: 101726, cores: 1) Dec 16 17:46:56.191635 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: spawned uWSGI worker 2 (pid: 101727, cores: 1) Dec 16 17:46:56.191858 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 17:46:57.937641 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:46:57.937641 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: from cryptography.utils import int_from_bytes Dec 16 17:46:57.938332 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:46:57.938332 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: from cryptography.utils import int_from_bytes Dec 16 17:46:57.938788 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:46:57.938788 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: from cryptography.utils import int_from_bytes Dec 16 17:46:57.938900 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:46:57.938900 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: from cryptography.utils import int_from_bytes Dec 16 17:47:00.537999 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 17:47:00.538714 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 17:47:00.538828 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 17:47:00.539129 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 17:47:00.539383 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 17:47:00.539774 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.540099 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.540336 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 17:47:00.540709 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.541128 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 17:47:00.541238 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.541238 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.541400 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 17:47:00.541501 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.541618 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 17:47:00.541709 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.541835 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 17:47:00.542034 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542219 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542361 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542552 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542684 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542899 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.542992 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543217 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543301 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819200-2-iscsi {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543544 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543662 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543859 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.543944 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544168 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544256 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544485 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544574 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544788 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.544871 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545057 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545194 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545395 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545489 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545703 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819200-2-iscsi {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.545906 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.546006 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547119 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547235 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547305 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547389 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547462 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547535 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547609 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547677 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547746 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547817 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547882 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.547953 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548218 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548344 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548537 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548674 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548856 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.548987 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549170 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549270 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549521 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549639 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819200-2-iscsi {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549834 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.549928 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.550150 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.550394 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.550718 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.550912 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.551114 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.551304 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.551528 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.551691 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.551889 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552097 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552235 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819200-2-iscsi {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552411 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552556 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552690 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.552871 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553011 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553152 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553299 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553471 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553610 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553750 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.553888 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554046 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554191 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554324 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554456 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554596 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554793 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.554938 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555086 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555086 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555342 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555475 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555620 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555760 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.555899 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556032 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556163 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556295 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556448 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556608 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556801 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.556947 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557220 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557362 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557574 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557574 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557835 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.557835 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558122 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558122 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558397 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558544 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558711 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.558855 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559089 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559244 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559387 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559533 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559681 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.559822 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560014 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560153 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560294 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560437 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560582 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560715 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560863 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.560997 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561135 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561274 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561407 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561551 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561690 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561831 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.561965 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562098 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562238 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562397 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562537 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562719 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562719 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562976 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.562976 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563237 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563371 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563504 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563647 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563787 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.563920 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564075 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564215 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564346 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564478 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564615 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564760 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.564899 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565039 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565180 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565313 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565444 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565589 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565722 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565864 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.565997 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566133 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566266 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566406 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566540 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566688 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566837 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.566971 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567104 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567251 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567393 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567531 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567679 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567812 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.567960 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568137 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568291 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568430 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568563 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568701 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.568842 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569005 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569231 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569377 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569520 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569667 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569809 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.569955 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570098 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570233 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570371 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570504 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570672 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570813 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.570953 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571096 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571233 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571376 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571520 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571730 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.571930 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.572079 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.572419 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.572419 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.572811 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.572972 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573115 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573248 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573383 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573526 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573673 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573806 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.573947 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574081 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574213 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574368 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574510 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574691 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574842 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.574976 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575119 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575332 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575470 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575622 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575756 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.575895 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576028 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576173 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576307 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576439 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576571 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576703 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576833 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.576977 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577119 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577263 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577414 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577549 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577680 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577821 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.577954 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578102 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578243 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578375 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578506 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578678 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578825 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.578965 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.579173 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.579474 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.579637 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.579779 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.579918 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580066 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580201 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580344 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580486 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580628 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580763 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.580895 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581026 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581176 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581321 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581454 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581592 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581726 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.581897 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.582042 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.582190 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.582330 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.582472 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.582605 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.582786 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.582931 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.583078 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.583210 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.583342 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:47:00.583474 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.583680 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.583897 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584047 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584184 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584318 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584451 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584591 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584734 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.584953 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585167 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585325 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585464 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585613 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585749 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.585889 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586026 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586158 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586290 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586517 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586760 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.586911 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587063 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587208 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587389 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587541 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587681 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.587909 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588059 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588209 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588416 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588627 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588788 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.588927 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589063 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589213 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589363 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589609 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589759 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.589897 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590031 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590172 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590305 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590496 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590822 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.590969 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591104 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591265 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591413 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591555 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591690 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591823 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.591954 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.592086 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.592226 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.592361 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.592499 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.592996 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593131 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593266 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593416 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593550 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593726 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.593885 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594029 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594163 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594391 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594601 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594797 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.594939 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595074 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595218 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595361 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595508 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595641 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595780 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.595915 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596060 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596232 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596378 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596520 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596654 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.596861 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597150 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597301 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597439 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597587 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597721 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.597855 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598003 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598139 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598286 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598429 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598563 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598774 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.598919 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599061 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599196 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599340 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599491 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599733 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.599882 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600026 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600167 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600308 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600442 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600583 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600719 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600851 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.600983 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601122 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601267 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601409 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601543 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601677 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601818 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.601957 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602102 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602244 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602377 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602584 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602815 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.602962 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.603114 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.603265 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.603431 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.603575 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.603836 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604026 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604177 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604314 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604455 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604764 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.604921 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605100 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605266 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605441 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605577 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605711 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.605852 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606065 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606266 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606430 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606568 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606750 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.606907 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607045 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607185 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607334 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607475 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607616 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607762 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.607897 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608043 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608177 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608319 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608461 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608605 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608740 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.608882 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609017 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609161 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609302 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609443 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609583 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609735 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.609959 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610100 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610247 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610390 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610524 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610681 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610820 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.610952 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611109 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611245 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611379 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611513 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611751 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.611950 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612110 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612255 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612401 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612536 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612669 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.612810 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613013 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613235 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613386 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613533 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613669 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613811 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.613953 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614087 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614222 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614361 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614494 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614687 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614831 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.614979 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615112 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615245 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615467 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615681 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615831 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.615976 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616113 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616254 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616392 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616538 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616680 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616814 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.616959 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617094 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617264 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617417 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617558 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617692 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.617900 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618100 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618263 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618406 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618560 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618736 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.618872 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619075 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619278 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619541 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619687 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619823 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.619974 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620191 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620341 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620484 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620620 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620778 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.620918 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621094 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621244 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621410 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621548 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621723 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.621869 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622040 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622187 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622350 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622498 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622698 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622840 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.622985 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623129 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623296 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623436 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623602 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623741 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.623915 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624054 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624241 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624380 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624555 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624692 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.624877 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625023 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625189 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625328 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625505 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625728 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.625873 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626006 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626149 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626290 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626425 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626572 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626739 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.626874 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627017 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627169 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627312 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627456 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627722 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.627901 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628042 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628212 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628359 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628502 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628642 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628808 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.628962 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629118 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629253 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629385 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629518 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629689 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.629828 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630003 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630143 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630364 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630504 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630691 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630832 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.630976 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631126 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631266 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631400 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631533 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631666 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631838 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.631978 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632142 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632279 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632449 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632596 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632732 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.632864 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633038 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633180 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633342 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633485 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633667 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633808 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.633980 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634118 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634281 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634447 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634639 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634806 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.634957 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635137 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635277 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635459 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635599 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635821 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.635960 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636093 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636239 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636375 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636508 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636691 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.636830 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637009 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637157 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637357 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637614 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637753 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.637886 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638020 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638162 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638324 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638526 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638691 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.638874 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639024 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639179 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639329 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639467 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639600 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639772 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.639918 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.640082 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.640222 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.640443 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.640604 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641016 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641164 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641318 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641482 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641625 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641765 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.641936 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642090 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642241 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642382 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642559 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642747 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.642917 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643073 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643243 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643398 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643561 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643705 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643858 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.643997 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644160 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644308 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644447 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644588 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644737 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.644878 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645054 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645200 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645351 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645496 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645644 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645786 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.645932 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646079 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646220 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646359 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646506 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646671 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646819 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.646959 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647145 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647312 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647462 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647611 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647764 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.647918 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648060 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648199 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648337 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648476 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648623 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648769 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.648911 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649050 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649200 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649339 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649558 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649700 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649840 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.649987 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.650129 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.650420 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.650854 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651027 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651170 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651310 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651461 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651614 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651760 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.651900 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652050 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652191 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652331 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652478 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652622 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652760 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.652900 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653047 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653188 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653345 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653487 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653626 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653771 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.653911 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654059 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654208 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654355 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654495 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654658 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654804 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.654960 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655108 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655264 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655403 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655543 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655688 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655836 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.655984 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656125 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656265 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656412 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656558 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656706 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.656875 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657026 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657174 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657316 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657468 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657610 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657749 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.657888 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658027 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658173 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658321 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658463 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658601 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658796 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.658948 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659089 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659242 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659386 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659525 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659671 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659811 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.659960 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660154 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660300 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660441 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660587 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660729 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.660973 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661129 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661271 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661411 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661551 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661707 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.661856 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662010 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662160 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662301 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662443 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662583 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662757 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.662924 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663065 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663204 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663350 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663490 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663638 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663778 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.663917 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664055 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664194 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664341 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664482 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664622 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664780 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.664921 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665060 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665207 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665356 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665504 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665648 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.665787 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666050 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666210 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666360 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666691 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666855 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.666997 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667136 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667286 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667435 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667576 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667717 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667717 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.667993 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668140 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668287 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668436 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668583 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668734 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.668892 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669033 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669171 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669312 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669451 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669741 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.669884 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670029 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670171 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670309 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670448 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670610 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670793 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.670953 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671175 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671322 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671483 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671624 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671763 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.671904 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672043 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672204 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672360 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672509 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672660 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672800 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.672939 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673086 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673234 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673375 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673521 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673660 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673800 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.673939 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674091 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674235 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674375 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674524 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674710 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.674856 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675008 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675150 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675290 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675435 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675575 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675722 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.675871 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676025 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676166 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676315 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676455 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676601 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676741 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.676881 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677048 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677192 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677339 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677560 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677702 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677841 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.677980 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678126 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678278 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678426 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678575 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678741 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.678892 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679055 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679206 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679356 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679496 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679643 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679783 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.679933 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680086 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680239 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680380 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680519 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680658 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680796 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.680971 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681113 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681260 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681401 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681589 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681731 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.681878 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682022 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682172 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682335 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682483 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682659 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.682816 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683037 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683203 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683347 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683500 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683650 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683791 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.683936 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684087 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684298 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684533 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684690 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684831 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.684971 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685132 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685274 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685412 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685565 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685706 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685845 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.685982 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.686133 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.686357 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.686580 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.686779 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.686924 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687064 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687232 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687427 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687580 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687723 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.687869 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688009 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688155 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688314 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688455 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688594 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688742 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.688883 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689022 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689175 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689317 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689457 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689595 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689740 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.689888 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690029 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690187 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690341 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690503 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690689 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.690851 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691004 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691148 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691286 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691428 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691566 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691747 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.691896 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692061 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692203 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692350 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692490 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692659 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692806 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.692974 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693119 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693295 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693449 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693616 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693768 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.693915 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694066 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694227 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694386 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694527 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694715 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.694861 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695004 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695174 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695335 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695481 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695620 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695796 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.695942 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696150 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696305 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696482 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696629 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696822 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.696990 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.697172 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.697411 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.697569 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.697720 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.697868 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698047 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698213 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698355 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698505 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698682 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698829 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.698978 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699120 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699262 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699410 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699553 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699693 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.699854 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700014 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700166 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700321 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700465 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700606 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700752 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.700900 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701040 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701188 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701330 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701470 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701626 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701774 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.701922 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702075 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702222 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702363 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702530 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702734 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.702895 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703038 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703178 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703323 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703471 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703611 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703759 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.703901 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704051 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704192 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704365 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704511 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704664 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.704805 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705006 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705152 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705293 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705580 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705728 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.705868 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706018 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706156 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706295 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706443 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706595 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706761 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.706902 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707051 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707234 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707394 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707538 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707677 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.707849 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708014 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708165 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708306 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708466 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708613 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708765 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.708905 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709053 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709195 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709342 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709483 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709629 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709777 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.709935 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710085 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710225 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710373 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710521 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710685 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710851 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.710993 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711140 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711279 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711425 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711565 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711722 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.711870 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712034 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712186 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712333 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712481 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712622 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.712818 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713041 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713208 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713428 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713585 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713728 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.713886 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714035 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714176 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714316 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714464 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714606 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714812 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.714955 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715095 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715245 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715387 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715526 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715700 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.715863 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716034 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716229 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716379 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716524 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716666 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716804 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.716944 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.717093 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.717263 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.717422 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.717571 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718066 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718224 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718378 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718541 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718725 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.718869 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719008 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719179 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719334 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719476 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719627 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719804 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.719950 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.720163 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.720355 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.720508 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.720692 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721010 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721158 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721308 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721448 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721627 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721779 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.721945 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722098 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722248 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722398 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722545 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722739 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.722885 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723036 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723177 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723318 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723462 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723601 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723796 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.723983 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724126 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724277 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724419 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724558 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724739 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.724892 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725058 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725204 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725375 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725529 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725679 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725827 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.725974 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726125 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726308 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726461 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726640 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726790 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.726962 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727107 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727260 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727409 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727582 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727729 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.727899 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728062 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728204 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728404 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728554 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728720 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.728939 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729164 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729314 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729469 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729611 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729752 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.729899 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730051 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730200 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730342 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730481 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730648 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730797 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.730946 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731101 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731288 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731435 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731613 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731760 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.731914 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732063 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732234 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732380 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732553 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732707 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.732935 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.733081 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.733371 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.733521 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.733705 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.733853 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734031 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734188 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734357 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734503 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734725 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.734886 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735037 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735179 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735318 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735457 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735618 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735772 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.735923 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736063 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736213 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736361 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736502 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736649 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.736880 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737023 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737164 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737304 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737450 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737601 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737750 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.737891 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738046 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738185 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738326 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738473 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738640 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.738851 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739180 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739327 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739493 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739634 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739818 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.739964 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740143 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740324 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740476 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740625 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740772 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.740913 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741054 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741195 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741354 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741502 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741643 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741783 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.741943 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742088 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742273 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742417 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742557 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742725 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.742879 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743031 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743172 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743313 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743453 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743591 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.743731 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.744108 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.744388 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.744579 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.744723 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.744875 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745018 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745166 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745316 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745458 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745605 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745746 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.745886 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.746042 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749388 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749497 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749570 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749666 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749749 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749749 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749886 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.749886 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750005 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750070 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750144 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750221 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750295 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750370 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750445 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750445 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750583 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750702 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750775 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750841 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750907 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.750973 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751053 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751129 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751288 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751288 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751411 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751503 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751574 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751574 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751692 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751757 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751905 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.751984 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752063 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752130 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752197 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752263 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752336 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752410 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752477 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752477 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752594 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752659 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752752 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.752912 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.753123 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.753223 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.753509 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.753763 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.753867 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754147 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754232 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754474 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754577 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754820 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.754915 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755129 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755227 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755436 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755521 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755762 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.755855 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756067 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756157 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756378 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756476 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756688 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756780 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.756997 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757081 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757308 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757412 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757622 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757706 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.757928 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758029 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758240 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758420 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758546 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758655 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758883 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.758976 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759196 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759291 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759513 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759627 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759865 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.759958 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.760188 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.760507 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.760611 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.760818 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.760916 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761136 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761245 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761445 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761543 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761761 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.761856 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762079 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762189 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762390 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762485 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762731 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.762847 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763039 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763194 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763407 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763580 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763735 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.763858 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764044 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764168 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764383 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764515 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764700 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.764823 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765024 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765147 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765347 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765483 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765662 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765786 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.765983 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766106 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766295 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766427 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766671 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766812 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.766970 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767091 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767283 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767407 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767609 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767738 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.767914 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768036 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768240 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768364 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768523 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768656 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768832 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.768954 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769159 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769282 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769466 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769778 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.769901 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770098 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770220 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770411 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770549 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770756 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.770887 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771068 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771192 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771380 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771501 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771700 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.771821 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772009 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772130 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772315 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772453 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772641 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772762 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.772953 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773082 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773264 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773385 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773575 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773696 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.773889 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774020 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774192 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774314 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774504 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774662 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774841 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.774973 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.775161 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.775337 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.775518 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.775640 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.775843 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.776117 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.776360 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.776483 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.776685 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.776809 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777005 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777129 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777319 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777441 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777649 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777771 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.777962 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778232 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778358 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778474 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778578 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778742 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.778916 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779049 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779236 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779361 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779553 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779683 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.779878 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780003 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780197 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780318 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780515 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780648 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780837 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.780959 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781163 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781285 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781489 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781619 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781816 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.781937 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782145 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782267 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782457 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782588 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782798 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.782931 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.783104 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.783226 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.783353 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 17:47:00.783488 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.783748 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.784062 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:47:00.784300 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 17:47:00.808212 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:00.813433 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:00.875510 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.context [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a2b8e0-0513-40e2-83b8-2a65c2eb69c2(cell1) {{(pid=101726) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 17:47:00.879836 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:47:00.881418 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:47:00.881824 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.context [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a2b8e0-0513-40e2-83b8-2a65c2eb69c2(cell1) {{(pid=101727) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 17:47:00.882220 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:47:00.884213 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:47:00.886410 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_concurrency.lockutils [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:47:00.888290 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_concurrency.lockutils [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:47:00.889155 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_concurrency.lockutils [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:47:00.891120 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_concurrency.lockutils [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:47:00.895885 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:00.898427 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:00.905950 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:00.909120 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:01.061559 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_db.sqlalchemy.engines [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:01.073924 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:47:01.409092 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:47:01.412194 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: WARNING keystonemiddleware.auth_token [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:47:01.416009 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:47:01.418935 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: WARNING keystonemiddleware.auth_token [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:47:01.762811 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:47:01.765049 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: WARNING keystonemiddleware.auth_token [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:47:01.768290 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: WARNING keystonemiddleware.auth_token [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:47:01.770535 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: WARNING keystonemiddleware.auth_token [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:47:01.773510 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef12af39c0 pid: 101726 (default app) Dec 16 17:47:01.775678 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:47:01.775829 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef12af39c0 pid: 101727 (default app) Dec 16 17:47:01.777044 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5e97449c-296f-48a1-94fe-170062851c09 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001976 Dec 16 17:47:01.777484 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Thu Dec 16 17:47:01 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:28.653650 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:28.656274 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002985 Dec 16 17:48:28.656894 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:28 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:29.157898 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-19612bc4-eb4c-4292-a8b8-90a98f70ce8b admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:29.189406 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-19612bc4-eb4c-4292-a8b8-90a98f70ce8b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.525596 Dec 16 17:48:29.190192 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Dec 16 17:48:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:31.770771 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:31.772073 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-e4f5ac1d-4c9f-4df0-ba25-c12333137fba None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Dec 16 17:48:31.772647 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:31.840127 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-f02470a2-3d40-4485-aac7-6f7a1fab41f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:31.858456 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:48:31.858456 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:48:31.901436 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-f02470a2-3d40-4485-aac7-6f7a1fab41f1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.120923 Dec 16 17:48:31.910756 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:32.132229 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-06d2b15d-d654-4c10-83dc-5f61245d458f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:32.136238 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:48:32.136238 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: warnings.warn(msg) Dec 16 17:48:32.203620 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-06d2b15d-d654-4c10-83dc-5f61245d458f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292568 Dec 16 17:48:32.204379 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Dec 16 17:48:31 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:34.792459 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-f02470a2-3d40-4485-aac7-6f7a1fab41f1 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:34.794121 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-f02470a2-3d40-4485-aac7-6f7a1fab41f1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Dec 16 17:48:34.797992 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:34 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:48:34.953412 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-a10c51de-9637-4a5b-b18d-f3a874dab310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:34.980715 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:48:34.980715 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: warnings.warn(msg) Dec 16 17:48:35.011730 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-a10c51de-9637-4a5b-b18d-f3a874dab310 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.206223 Dec 16 17:48:35.013486 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:48:35.030116 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-6d3d5521-2294-4885-947e-9f6f8974f0b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:35.030480 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:48:35.030480 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:48:35.073136 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-6d3d5521-2294-4885-947e-9f6f8974f0b8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047582 Dec 16 17:48:35.074660 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Dec 16 17:48:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:48:37.640840 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-a10c51de-9637-4a5b-b18d-f3a874dab310 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:37.642788 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-a10c51de-9637-4a5b-b18d-f3a874dab310 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002540 Dec 16 17:48:37.643218 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:37.713898 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2a43c879-7314-4644-98c0-5104b1d6f5ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:37.736867 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2a43c879-7314-4644-98c0-5104b1d6f5ae admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086622 Dec 16 17:48:37.737985 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:37.750157 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-3b163a21-e27c-42c8-9f02-1ec5d73526e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:37.785021 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-3b163a21-e27c-42c8-9f02-1ec5d73526e3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036140 Dec 16 17:48:37.786340 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Dec 16 17:48:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:40.281247 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2a43c879-7314-4644-98c0-5104b1d6f5ae admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:40.282759 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2a43c879-7314-4644-98c0-5104b1d6f5ae admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Dec 16 17:48:40.283382 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:40.357440 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-11fdd588-67ce-4e5d-b6a3-b60dff415fdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "disk": 10}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:40.378531 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-11fdd588-67ce-4e5d-b6a3-b60dff415fdf admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087369 Dec 16 17:48:40.379435 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:40.392279 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5bf4c69e-6856-46fb-a908-ba089cbbab92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:40.420439 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5bf4c69e-6856-46fb-a908-ba089cbbab92 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031695 Dec 16 17:48:40.432287 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Dec 16 17:48:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:43.059458 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-11fdd588-67ce-4e5d-b6a3-b60dff415fdf admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:43.060465 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-11fdd588-67ce-4e5d-b6a3-b60dff415fdf admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Dec 16 17:48:43.060873 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:48:43.141538 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:43.169427 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098553 Dec 16 17:48:43.177598 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:43.182921 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-33be3388-ab21-4a2b-a641-a18002be0a85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:43.211091 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-33be3388-ab21-4a2b-a641-a18002be0a85 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031666 Dec 16 17:48:43.222836 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Dec 16 17:48:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:45.931405 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:45.932882 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Dec 16 17:48:45.933399 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:45 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:46.016674 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-56fed007-64a4-41e4-8a39-3dfc3a197b0f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:46.042584 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-56fed007-64a4-41e4-8a39-3dfc3a197b0f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.093960 Dec 16 17:48:46.043205 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Dec 16 17:48:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:48:48.785426 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:48.787225 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-264ac27f-e1dd-43e0-a92d-8955b6b6dcc6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003731 Dec 16 17:48:48.787740 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:48 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:48.883768 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-a9310895-d79a-4155-8c5e-3a559d8c1002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:48.906993 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-a9310895-d79a-4155-8c5e-3a559d8c1002 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.108702 Dec 16 17:48:48.907589 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:48.927078 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-48d1796a-b2ef-426b-ae18-458e6c70cf3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:48.963529 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-48d1796a-b2ef-426b-ae18-458e6c70cf3a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042742 Dec 16 17:48:48.964449 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Dec 16 17:48:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:48:51.885769 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-a9310895-d79a-4155-8c5e-3a559d8c1002 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:51.887529 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-a9310895-d79a-4155-8c5e-3a559d8c1002 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002549 Dec 16 17:48:51.888412 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:51 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:51.952269 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2d1c8a32-07a2-48ab-8fd3-80f22e9b6fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "name": "m1.small", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:51.973230 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2d1c8a32-07a2-48ab-8fd3-80f22e9b6fc5 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076382 Dec 16 17:48:51.973790 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:51.988846 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-12140e6c-6fa9-44c8-b40f-f3f1808b1ad6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:52.015634 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-12140e6c-6fa9-44c8-b40f-f3f1808b1ad6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032674 Dec 16 17:48:52.016467 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Dec 16 17:48:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:54.527780 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-2d1c8a32-07a2-48ab-8fd3-80f22e9b6fc5 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:54.527780 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-2d1c8a32-07a2-48ab-8fd3-80f22e9b6fc5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Dec 16 17:48:54.527780 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:48:54.595912 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e1e2184d-e98d-4249-bbfb-3d8e877b67fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:54.625015 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-e1e2184d-e98d-4249-bbfb-3d8e877b67fb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090647 Dec 16 17:48:54.626205 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:54 2021] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:48:54.649032 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-54e25fdb-c2e0-410e-86f6-20280e351dcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:54.686656 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-54e25fdb-c2e0-410e-86f6-20280e351dcc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043929 Dec 16 17:48:54.687513 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Dec 16 17:48:54 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:57.267594 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e1e2184d-e98d-4249-bbfb-3d8e877b67fb admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:57.268941 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-e1e2184d-e98d-4249-bbfb-3d8e877b67fb admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Dec 16 17:48:57.269951 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:48:57.352403 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-cb3acae0-66b2-43d3-90d8-fb91f82d659b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:57.377753 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-cb3acae0-66b2-43d3-90d8-fb91f82d659b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.100413 Dec 16 17:48:57.378336 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:48:57.394641 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-ffca2d8e-269e-428e-8d16-794b30e7cbf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:48:57.432902 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-ffca2d8e-269e-428e-8d16-794b30e7cbf2 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042210 Dec 16 17:48:57.433675 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Dec 16 17:48:57 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:48:59.975235 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-cb3acae0-66b2-43d3-90d8-fb91f82d659b admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:48:59.977271 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-cb3acae0-66b2-43d3-90d8-fb91f82d659b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002415 Dec 16 17:48:59.977990 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:48:59 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:00.047743 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5"}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:00.067964 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083350 Dec 16 17:49:00.068748 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Dec 16 17:48:59 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:49:00.081384 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-ae6e7c1b-0b5b-4a13-937f-c62a26fac168 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:00.115225 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-ae6e7c1b-0b5b-4a13-937f-c62a26fac168 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037565 Dec 16 17:49:00.116581 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Dec 16 17:49:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:49:20.926973 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:20.927999 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Dec 16 17:49:20.928379 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:49:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:20.997950 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-75c2fbbc-4845-4805-bbdf-eb355882407a admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:21.015224 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-75c2fbbc-4845-4805-bbdf-eb355882407a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079210 Dec 16 17:49:21.015759 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Dec 16 17:49:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:22.632892 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:22.633946 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-792d6015-f261-4817-a89d-20538dafb97e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Dec 16 17:49:22.634410 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:22.834790 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5a1fd3dd-df37-4515-93a1-eaf4e69fb81f admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:22.841056 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-5a1fd3dd-df37-4515-93a1-eaf4e69fb81f admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 17:49:22.841641 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5a1fd3dd-df37-4515-93a1-eaf4e69fb81f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:22.842861 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5a1fd3dd-df37-4515-93a1-eaf4e69fb81f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069739 Dec 16 17:49:22.843443 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Dec 16 17:49:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 17:49:22.854562 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-750308a5-6324-4cd8-adf0-cdec26ae76ea admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:22.876385 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-750308a5-6324-4cd8-adf0-cdec26ae76ea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026165 Dec 16 17:49:22.876934 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:22.887819 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-7fc37ea4-7649-4838-9914-7aa287b11efd admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:22.909394 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-7fc37ea4-7649-4838-9914-7aa287b11efd admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025118 Dec 16 17:49:22.909952 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:22.920694 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-51ca3d02-f40a-4ad1-a7ab-21b4a1ac7e12 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:22.926650 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.wsgi [None req-51ca3d02-f40a-4ad1-a7ab-21b4a1ac7e12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 17:49:22.927239 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-51ca3d02-f40a-4ad1-a7ab-21b4a1ac7e12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:22.928009 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-51ca3d02-f40a-4ad1-a7ab-21b4a1ac7e12 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010985 Dec 16 17:49:22.928511 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Dec 16 17:49:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 17:49:24.430183 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-7fc37ea4-7649-4838-9914-7aa287b11efd admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:24.431203 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-7fc37ea4-7649-4838-9914-7aa287b11efd admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Dec 16 17:49:24.431635 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:24.636281 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-9cdc6e60-212d-49c4-b743-cf51d574d204 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:24.642479 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.wsgi [None req-9cdc6e60-212d-49c4-b743-cf51d574d204 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 17:49:24.643082 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-9cdc6e60-212d-49c4-b743-cf51d574d204 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:24.643889 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-9cdc6e60-212d-49c4-b743-cf51d574d204 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068993 Dec 16 17:49:24.644424 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Dec 16 17:49:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 17:49:24.660022 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-df4ba32e-3a0c-4103-8a43-12782321ab26 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:24.674921 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-df4ba32e-3a0c-4103-8a43-12782321ab26 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023007 Dec 16 17:49:24.675556 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:24.687120 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-2db688dc-4b5b-4202-ae73-002e19271804 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:24.702751 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-2db688dc-4b5b-4202-ae73-002e19271804 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019221 Dec 16 17:49:24.703261 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:24.713785 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e569c7c7-d2ad-492e-b28e-16d651de8c9c admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:24.719903 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-e569c7c7-d2ad-492e-b28e-16d651de8c9c admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 17:49:24.720381 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e569c7c7-d2ad-492e-b28e-16d651de8c9c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:24.721147 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e569c7c7-d2ad-492e-b28e-16d651de8c9c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011090 Dec 16 17:49:24.721666 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Dec 16 17:49:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 17:49:26.216272 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-2db688dc-4b5b-4202-ae73-002e19271804 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:26.217278 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-2db688dc-4b5b-4202-ae73-002e19271804 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Dec 16 17:49:26.218096 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:26.420523 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-76745612-1a8e-4a97-844d-5c69433f6cd5 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:26.428039 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.wsgi [None req-76745612-1a8e-4a97-844d-5c69433f6cd5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 17:49:26.428735 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-76745612-1a8e-4a97-844d-5c69433f6cd5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:26.429695 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-76745612-1a8e-4a97-844d-5c69433f6cd5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067383 Dec 16 17:49:26.430336 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:49:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 17:49:26.441335 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-f61efae0-d3d4-4ca2-b90a-a5a9b2607354 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:26.455622 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-f61efae0-d3d4-4ca2-b90a-a5a9b2607354 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018514 Dec 16 17:49:26.456165 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:26.469273 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:26.483590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020004 Dec 16 17:49:26.484118 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Dec 16 17:49:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:49:26.496502 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e172967f-74c2-4f55-8d0d-d15f62649917 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:26.503806 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.wsgi [None req-e172967f-74c2-4f55-8d0d-d15f62649917 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 17:49:26.504397 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-e172967f-74c2-4f55-8d0d-d15f62649917 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:49:26.505499 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-e172967f-74c2-4f55-8d0d-d15f62649917 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014255 Dec 16 17:49:26.506078 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:49:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 16 17:49:28.028125 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:28.029278 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Dec 16 17:49:28.029684 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:49:28.241801 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-6fb17988-26df-4b04-8cca-3905ef4ea162 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:28.266723 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-6fb17988-26df-4b04-8cca-3905ef4ea162 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089789 Dec 16 17:49:28.267276 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Dec 16 17:49:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:49:29.796103 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:29.797115 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Dec 16 17:49:29.797542 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:49:30.008951 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-40c2a0d0-ac44-4235-be7e-6b7f5d805b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:30.036677 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-40c2a0d0-ac44-4235-be7e-6b7f5d805b3f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.092719 Dec 16 17:49:30.037244 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Dec 16 17:49:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:49:31.589247 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:31.590686 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Dec 16 17:49:31.591100 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:31.794004 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-05a5d4c7-17ee-414d-8e5f-4270f6476e6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:31.814847 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-05a5d4c7-17ee-414d-8e5f-4270f6476e6c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079560 Dec 16 17:49:31.815384 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Dec 16 17:49:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:49:33.333148 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:33.334154 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 16 17:49:33.334550 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:33.540145 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-fd3bded6-5e38-487c-92ea-dcbc5f4c7fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:49:33.559870 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-fd3bded6-5e38-487c-92ea-dcbc5f4c7fa1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084723 Dec 16 17:49:33.560478 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Dec 16 17:49:33 2021] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:49:35.098635 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:35.099643 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Dec 16 17:49:35.100035 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:49:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:49:35.306145 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-a51b4de4-de97-4a03-a6d6-1f8a8cb2aba8 admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:49:35.326270 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-a51b4de4-de97-4a03-a6d6-1f8a8cb2aba8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080369 Dec 16 17:49:35.326837 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1202 bytes} [Thu Dec 16 17:49:35 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:50:24.521481 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.522490 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-63ec2abc-21da-4ea8-b7ab-3280f26f9539 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Dec 16 17:50:24.523143 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 930 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:50:24.587517 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-666825bf-0cbf-4086-b38f-a49445721d8a admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.612252 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-666825bf-0cbf-4086-b38f-a49445721d8a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082262 Dec 16 17:50:24.612797 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:50:24.636422 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-f45d1b43-c3cd-49e4-b64f-5823f154c380 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.644906 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-f45d1b43-c3cd-49e4-b64f-5823f154c380 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012546 Dec 16 17:50:24.645438 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:50:24.658481 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-eb878a20-5821-4a2b-b3e5-6c55f7ea9c1c admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.667221 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-eb878a20-5821-4a2b-b3e5-6c55f7ea9c1c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012318 Dec 16 17:50:24.667773 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:50:24.680198 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-54465333-4933-4bcb-944c-9f321c114d12 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.688287 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-54465333-4933-4bcb-944c-9f321c114d12 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012211 Dec 16 17:50:24.688817 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:50:24.701210 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:50:24.709520 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011792 Dec 16 17:50:24.709959 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Dec 16 17:50:24 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:51:49.760375 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-86301475-0d9d-402c-ae58-ce90acde0d2a tempest-verify_tempest_config-1778275310 tempest-verify_tempest_config-1778275310-project] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:51:49.762545 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-86301475-0d9d-402c-ae58-ce90acde0d2a tempest-verify_tempest_config-1778275310 tempest-verify_tempest_config-1778275310-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.118416 Dec 16 17:51:49.763150 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 35/69] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Dec 16 17:51:49 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:53:18.149573 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:18.150704 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Dec 16 17:53:18.151102 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:53:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:53:18.458010 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:18.459230 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:53:18.459230 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:53:18.460809 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:18.461327 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:18.462139 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:18.462566 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:18.498898 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-5f1de17f-df3e-4675-95bc-52b1af9d5b27 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.187064 Dec 16 17:53:18.499535 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 36/71] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:53:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:53:20.044024 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:20.045048 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Dec 16 17:53:20.045470 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:53:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:53:20.243590 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:20.244762 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:53:20.244762 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:53:20.246299 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:20.246761 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:20.247544 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:20.247970 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:20.266859 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-1e4203fb-b5a7-46f6-a556-a12bf3637e61 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078885 Dec 16 17:53:20.267429 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 37/73] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:53:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:53:32.210791 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:32.211910 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Dec 16 17:53:32.212333 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 37/74] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:53:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:53:32.411579 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:32.412655 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:53:32.412655 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:53:32.414156 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:32.414586 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:32.415385 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:32.415801 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:32.439839 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-e2fcc693-3131-4534-8849-c2f4b73f2a58 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083620 Dec 16 17:53:32.440385 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 38/75] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:53:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:53:33.973834 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: DEBUG nova.api.openstack.wsgi [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] Calling method '>' {{(pid=101727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:33.975228 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: INFO nova.api.openstack.requestlog [None req-8d5384a2-f476-4bf7-9a92-9c95c7536f6f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Dec 16 17:53:33.975758 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: [pid: 101727|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Dec 16 17:53:33 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:53:34.186487 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG nova.api.openstack.wsgi [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] Calling method '>' {{(pid=101726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:53:34.187658 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:53:34.187658 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: warnings.warn(msg) Dec 16 17:53:34.189188 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:34.189627 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:34.190421 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:53:34.190886 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: DEBUG oslo_concurrency.lockutils [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:53:34.212091 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: INFO nova.api.openstack.requestlog [None req-876e9731-26ec-446e-b88d-3255434774c4 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084157 Dec 16 17:53:34.212643 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: [pid: 101726|app: 0|req: 39/77] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Dec 16 17:53:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:54:31.772727 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: Thu Dec 16 17:54:31 2021 - graceful shutdown triggered... Dec 16 17:54:31.773269 dv-cinder-819200-2-iscsi devstack@n-api.service[101726]: Gracefully killing worker 1 (pid: 101726)... Dec 16 17:54:31.772849 dv-cinder-819200-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 16 17:54:31.774144 dv-cinder-819200-2-iscsi devstack@n-api.service[101727]: Gracefully killing worker 2 (pid: 101727)... Dec 16 17:54:32.773217 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: worker 1 buried after 1 seconds Dec 16 17:54:32.773217 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: worker 2 buried after 1 seconds Dec 16 17:54:32.773217 dv-cinder-819200-2-iscsi devstack@n-api.service[101725]: goodbye to uWSGI. Dec 16 17:54:32.775828 dv-cinder-819200-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 16 17:54:32.776776 dv-cinder-819200-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 16 17:54:32.780379 dv-cinder-819200-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 17:54:32.793265 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 17:54:32 2021] *** Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: nodename: dv-cinder-819200-2-iscsi Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: machine: x86_64 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: clock source: unix Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: pcre jit disabled Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: detected number of CPU cores: 4 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: current working directory: / Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: detected binary path: /usr/bin/uwsgi-core Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: your processes number limit is 47680 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: your memory page size is 4096 bytes Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: detected max file descriptor number: 2048 Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: lock engine: pthread robust mutexes Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: thunder lock: enabled Dec 16 17:54:32.795635 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 17:54:32.796653 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 17:54:32.842287 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: Python main interpreter initialized at 0x559e5ff029c0 Dec 16 17:54:32.842287 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: python threads support enabled Dec 16 17:54:32.842287 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: your server socket listen backlog is limited to 100 connections Dec 16 17:54:32.842287 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: your mercy for graceful operations on workers is 90 seconds Dec 16 17:54:32.842739 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 17:54:32.842739 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: *** Operational MODE: preforking *** Dec 16 17:54:32.843424 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: *** uWSGI is running in multiple interpreter mode *** Dec 16 17:54:32.843424 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: spawned uWSGI master process (pid: 115897) Dec 16 17:54:32.843630 dv-cinder-819200-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 17:54:32.844313 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: spawned uWSGI worker 1 (pid: 115914, cores: 1) Dec 16 17:54:32.844591 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: spawned uWSGI worker 2 (pid: 115915, cores: 1) Dec 16 17:54:32.850664 dv-cinder-819200-2-iscsi devstack@n-api.service[115897]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 17:54:34.750185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:54:34.750185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: from cryptography.utils import int_from_bytes Dec 16 17:54:34.750185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:54:34.750185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: from cryptography.utils import int_from_bytes Dec 16 17:54:34.757295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:54:34.757295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: from cryptography.utils import int_from_bytes Dec 16 17:54:34.757863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 17:54:34.757863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: from cryptography.utils import int_from_bytes Dec 16 17:54:37.193367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 17:54:37.193959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 17:54:37.194135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 17:54:37.194491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 17:54:37.194761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 17:54:37.195168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.195499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.196165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.196165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.196484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.196795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.197123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.197417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.197788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.198017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.198338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.198703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819200-2-iscsi {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.199037 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.208973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819200-2-iscsi {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.209903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.210857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 17:54:37.211245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.211335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 17:54:37.211413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.211413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.211558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 17:54:37.211639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.211729 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 17:54:37.211818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.211895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 17:54:37.212007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.212917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.213083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.213346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.213476 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.213680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.213796 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214117 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.214955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.215121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.215325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.215585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.215720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.215940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819200-2-iscsi {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216628 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.216945 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.217944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.218472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.218652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.218900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219200 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.219868 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220024 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220606 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.220756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.221260 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.221412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.221566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.221738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.221956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.222952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819200-2-iscsi {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.223991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.224146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.224296 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.224559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.224721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.224874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.225899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.226859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227471 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.227909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.228966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.229871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.230019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.230160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.230308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.230461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.230831 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.231455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.231634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.231790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.231951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232629 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.232773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.233935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.234075 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.234224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.234371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.234723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.234885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.235035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.235184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.235338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.236941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237537 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.237975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238780 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.238933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.239963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.240849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.240989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.241137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.241311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.241594 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.241769 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.242009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.242009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.242396 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.242554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.242731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.242885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.243038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.243186 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.243346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.243497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.243637 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.243791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.243947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.244118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.244269 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.244411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.244559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.244718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.244949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.245187 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.245343 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.245491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.245640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.245790 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.245931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.246086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.246322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.246322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.246821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.247068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.247291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.247451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.247594 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.247742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.248020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.248185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.248329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.248485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.248638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.248638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.248919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.249060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.249208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.249208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.249492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.249633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.249779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.249929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.250085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.250085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.250361 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.250511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.250680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.250838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.250987 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.251136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.251279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.251428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.251731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.251895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.252065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.252306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.252536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.252860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.253024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.253176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.253324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.253468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.253617 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.253773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.253927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.254079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.254227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.254368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.254519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.254678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.254824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.255003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.255242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.255407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.255561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.255717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.255717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.256002 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.256144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.256284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.256284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.256565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.256708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.256849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.257001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.257143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.257297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.257446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.257588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.257730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.257870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.258020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.258173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.258315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.258467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.258610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 17:54:37.258806 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.258959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259692 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.259992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.260884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261465 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.261967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.263908 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.264949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.265097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.265271 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.265513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.265708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.265872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266159 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266159 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266794 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.266939 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267089 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.267994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.268938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269233 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269663 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.269973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270256 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270256 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.270843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271393 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271393 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.271849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272586 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.272914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273827 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.273978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274128 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274421 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.274953 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275260 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275659 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.275960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.276239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.276389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.276539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.276682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.276921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.277091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.277249 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.277415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.277620 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.277932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.278984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.279709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.279709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280162 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.280911 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.281962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.282248 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.282407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.282407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.282737 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.282737 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.283035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.283280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.283515 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.283726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.283883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284184 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284484 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.284932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285675 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.285909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286057 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286207 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.286973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.287847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.288904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289056 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289489 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.289943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.290835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.291655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.291821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.291973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.292123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.292420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.292579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.292723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.292864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.293036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.293186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.293554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.293943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.294132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.294337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.294507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.294683 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.294879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295616 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.295909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296502 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.296922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297371 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297680 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.297980 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.298140 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.298290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.298440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.298592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.298765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299111 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299410 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.299885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300062 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300609 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.300896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301343 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.301917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.302065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.302225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.302555 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.302770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.302925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303218 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303762 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.303920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.304928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.305977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.306133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.306282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.306429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.306587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.306763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307556 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.307849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308005 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.308830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.309025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.309258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.309519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.309785 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.309955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310120 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.310969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.311914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.312076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.312233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.312381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.312701 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.312867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.313902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314484 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.314985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.315917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316071 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316218 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.316778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.317086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.317835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.317997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318806 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.318953 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319100 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.319872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.320968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.321135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.321422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.321592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.321744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.321898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.322062 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.322218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.322375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.322534 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.322873 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.323887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.324051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.324200 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.324752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.324913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325401 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325549 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.325862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326010 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.326992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.327161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.327320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.327468 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.327614 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.327760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328174 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.328968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.329124 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.329290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.329440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.329601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.329840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330001 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330304 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.330952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331737 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.331886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332663 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.332829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.333143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.333295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.333456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.333620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.333777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334021 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334689 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.334962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.335918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.336898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.337906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.338957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.339112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.339261 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.339424 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.339592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.339750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.340006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.340229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.340479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.340745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.340917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.341967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.342121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.342278 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.342439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.342601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.342835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.343448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.343615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.343773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.343931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.344966 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.345981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346411 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346567 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.346910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347693 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.347842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.348007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.348421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.348581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.348581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.348874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349655 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.349978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.350926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351398 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351556 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351704 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.351859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352007 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.352895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.353193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.353354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.353658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.353822 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.353981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.354156 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.357374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.357573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.357736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.357890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.358980 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359142 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.359930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.360863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361165 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.361956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362048 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362680 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.362906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363341 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363452 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.363952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.364953 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365545 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.365986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366211 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366541 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.366933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.367974 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368200 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368317 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.368881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.369985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.370960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.371078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.371078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.371512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.371687 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.371838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.372898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373945 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.373945 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.374895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375432 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.375887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376005 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.376906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377632 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.377972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378456 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.378915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379125 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379587 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379822 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.379937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.380991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381111 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.381894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.382984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.383859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384249 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.384912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385029 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.385914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386357 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.386726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.387988 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388442 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.388898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389486 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.389958 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390194 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.390913 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391179 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391431 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391551 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391669 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391780 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.391888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392521 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392632 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.392970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.393970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.394239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.394429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.394554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.394719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.394992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395689 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.395941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.396987 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.397909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.398970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.399920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400029 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400775 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.400885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401037 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401269 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.401925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402612 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.402981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403501 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.403947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404475 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.404838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405174 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.405991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406230 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406459 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.406899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.407949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408619 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.408943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.409833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410369 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.410950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411410 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411734 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.411937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.412128 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.412252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.412455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.412581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.412913 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413400 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.413848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.414911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415419 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.415878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416469 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.416998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.417165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.417320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.417516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.417649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.418522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.418522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.418907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419612 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419612 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.419955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420416 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.420839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421100 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421218 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.421866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422693 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.422998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423614 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.423920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.424919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.425863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.426838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.427929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.428058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.428356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.428577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.428696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.428942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429079 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.429964 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430577 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.430940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.431136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.431250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.431435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.431566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.431787 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.432798 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433047 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433385 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.433867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.434971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435103 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.435853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436251 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436371 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436622 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.436866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437159 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437487 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.437848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438545 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.438902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439366 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.439855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440655 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.440985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.441998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.442097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.442315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.442414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.442699 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.442796 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.443982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.444081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.444230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 17:54:37.444325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.444598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.444919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.445229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.445615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.445894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.446219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.446542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.446892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.447197 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.447499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.447808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.448137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.448500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.448814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.449138 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.449480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.449806 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.450114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.450433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.450777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.451100 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.451411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.451743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.452052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.452365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.452679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.452996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.453305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.453616 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.453944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.454269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.454572 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.454939 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.455259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.455577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.455895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.456540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.456540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.456832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.457146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.457454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.457760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.458069 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.459056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.459056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.459056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.459350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.459663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.460008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.460321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.460678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.461006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.461332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.461642 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.461950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 17:54:37.462288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 17:54:37.468349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.485739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_db.sqlalchemy.engines [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.538266 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.context [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a2b8e0-0513-40e2-83b8-2a65c2eb69c2(cell1) {{(pid=115914) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 17:54:37.542565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:54:37.544246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:54:37.545088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:54:37.547133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:54:37.554235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.context [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68a2b8e0-0513-40e2-83b8-2a65c2eb69c2(cell1) {{(pid=115915) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 17:54:37.558708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:54:37.560429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.560716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:54:37.561285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.561568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:54:37.563607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:54:37.576842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_db.sqlalchemy.engines [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.577741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_db.sqlalchemy.engines [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.726326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:37.739331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_db.sqlalchemy.engines [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 16 17:54:38.055307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: WARNING keystonemiddleware.auth_token [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:54:38.062145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: WARNING keystonemiddleware.auth_token [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:54:38.067986 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: WARNING keystonemiddleware.auth_token [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:54:38.074676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: WARNING keystonemiddleware.auth_token [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:54:38.413755 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: WARNING keystonemiddleware.auth_token [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:54:38.419122 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: WARNING keystonemiddleware.auth_token [None req-7ab2d547-d84f-4661-bce4-e7f32cf180b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:54:38.423959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: WARNING keystonemiddleware.auth_token [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 17:54:38.424498 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e5ff029c0 pid: 115914 (default app) Dec 16 17:54:38.429334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: WARNING keystonemiddleware.auth_token [None req-1700dd17-e7db-403e-b4ab-e13d1f71a5e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 17:54:38.435083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e5ff029c0 pid: 115915 (default app) Dec 16 17:55:13.117223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-691029374", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "301af5f0-dae2-46f9-946d-d976042676c5"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:13.450403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d18b5864-4b65-4569-b887-316bb8852386 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Action: 'create', calling method: .version_select at 0x7fca1d794e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-58231049", "metadata": {"Type": "work"}}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:13.833297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] validate_networks() for [('301af5f0-dae2-46f9-946d-d976042676c5', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:55:14.937931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d18b5864-4b65-4569-b887-316bb8852386 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.001991 Dec 16 17:55:14.939876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Dec 16 17:55:11 2021] POST /compute/v2.1/os-volumes => generated 351 bytes in 3005 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 16 17:55:15.475239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247541817", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d5430d91-7e76-4358-9d35-08edfd4e96f5"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:15.556137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:55:15.556765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:55:15.557014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:55:15.557646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:55:15.558323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:55:15.588483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:15.589510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:15.592040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:15.592750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:15.627347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] validate_networks() for [('d5430d91-7e76-4358-9d35-08edfd4e96f5', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:55:15.677274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Getting quotas for project 1670f03a08914a50ac3c502be6456794. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:15.684276 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Getting quotas for user a71fe44f025c4454ae3756ae55a67f16 and project 1670f03a08914a50ac3c502be6456794. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:15.705299 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:55:15.708383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:55:15.822482 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-71b0e8ab-82c0-44e5-b928-21b48787a2c5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.345774 Dec 16 17:55:15.823208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 1/2] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:55:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 4348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:55:15.832024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-99236825-34bd-4f3e-b2c7-3bc0a47666b6 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Calling method '.version_select at 0x7fca1cd91790>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:15.957724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-99236825-34bd-4f3e-b2c7-3bc0a47666b6 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa" status: 200 len: 352 microversion: 2.1 time: 0.132973 Dec 16 17:55:15.958289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:15 2021] GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:15.963078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-64a0a426-87d7-4c87-9ae3-c73158a20349 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:15.963691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-64a0a426-87d7-4c87-9ae3-c73158a20349 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:16.294381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-64a0a426-87d7-4c87-9ae3-c73158a20349 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:16.340263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-64a0a426-87d7-4c87-9ae3-c73158a20349 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1214 microversion: 2.1 time: 0.380781 Dec 16 17:55:16.341380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:15 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:16.346375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fc353c52-f5ce-4400-8c03-96b6f4d9961e tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Calling method '.version_select at 0x7fca1c519af0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:16.479633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fc353c52-f5ce-4400-8c03-96b6f4d9961e tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa" status: 200 len: 352 microversion: 2.1 time: 0.136985 Dec 16 17:55:16.480965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 4/5] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:16 2021] GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:16.487662 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5dc88487-458e-4cd6-ace0-a5854329cd2d tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c523ca0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:16.624494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5dc88487-458e-4cd6-ace0-a5854329cd2d tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/200d4bbe-83c0-4b4f-bf7c-97ae609f402b" status: 200 len: 351 microversion: 2.1 time: 0.142359 Dec 16 17:55:16.634330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 5/6] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:16 2021] GET /compute/v2.1/os-volumes/200d4bbe-83c0-4b4f-bf7c-97ae609f402b => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:16.641162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c4aeeecd-e933-4634-8693-91567cf6cd61 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Calling method '.version_select at 0x7fca1c523f70>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:16.781006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c4aeeecd-e933-4634-8693-91567cf6cd61 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa" status: 202 len: 0 microversion: 2.1 time: 0.145209 Dec 16 17:55:16.782144 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 6/7] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 17:55:16 2021] DELETE /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:55:16.789774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5dcacbf0-0a74-4bf1-9207-715ccdea9395 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Calling method '.version_select at 0x7fca1c5199d0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:16.875160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5dcacbf0-0a74-4bf1-9207-715ccdea9395 tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa" status: 200 len: 351 microversion: 2.1 time: 0.088967 Dec 16 17:55:16.876493 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 7/8] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:16 2021] GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:17.185696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:55:17.186220 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:55:17.186657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:55:17.187091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:55:17.187733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:55:17.221045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:17.221689 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:17.235256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:17.238474 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:17.326876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:17.354754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for user e85da5cbc170449cb9f74d845845bc35 and project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:17.357993 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c91b4501-5872-45bc-90e0-70be426033b0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:17.358648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c91b4501-5872-45bc-90e0-70be426033b0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:17.378717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:55:17.382430 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:55:17.553087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9e6305e3-3d86-4fb2-8178-e6b5414f610b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.610321 Dec 16 17:55:17.556079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 2/9] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:55:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:55:17.570215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-92a5ef50-4535-4a90-967d-cafafa440183 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:17.573223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-92a5ef50-4535-4a90-967d-cafafa440183 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:17.702702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-92a5ef50-4535-4a90-967d-cafafa440183 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:17.736970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-92a5ef50-4535-4a90-967d-cafafa440183 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1218 microversion: 2.1 time: 0.170102 Dec 16 17:55:17.737997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 3/10] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:17 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:17.890236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-97fab5f5-0e7d-4dd1-849f-540472ab67cc tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Calling method '.version_select at 0x7fca1cd11dc0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:17.978042 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-97fab5f5-0e7d-4dd1-849f-540472ab67cc tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] HTTP exception thrown: Volume 8473da75-43f8-4087-8b84-a33859f42cfa could not be found. Dec 16 17:55:17.979526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-97fab5f5-0e7d-4dd1-849f-540472ab67cc tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] Returning 404 to user: Volume 8473da75-43f8-4087-8b84-a33859f42cfa could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:55:17.981152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-97fab5f5-0e7d-4dd1-849f-540472ab67cc tempest-VolumesGetTestJSON-826048790 tempest-VolumesGetTestJSON-826048790-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa" status: 404 len: 109 microversion: 2.1 time: 0.095978 Dec 16 17:55:17.992811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 4/11] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:17 2021] GET /compute/v2.1/os-volumes/8473da75-43f8-4087-8b84-a33859f42cfa => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:55:18.014134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c91b4501-5872-45bc-90e0-70be426033b0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:18.023718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c91b4501-5872-45bc-90e0-70be426033b0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1214 microversion: 2.1 time: 0.670227 Dec 16 17:55:18.024336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 8/12] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:17 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1214 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:18.272777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-73f92943-f271-40a7-b077-2101f02789ab tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1cd2ba60>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:18.375852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-73f92943-f271-40a7-b077-2101f02789ab tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/81c941b6-cae7-4886-a838-aea234364f85" status: 200 len: 351 microversion: 2.1 time: 0.107015 Dec 16 17:55:18.381979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 5/13] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:18 2021] GET /compute/v2.1/os-volumes/81c941b6-cae7-4886-a838-aea234364f85 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:18.753689 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a3e1f1a4-7510-4488-bb64-c5403a9c6bb7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:18.754937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a3e1f1a4-7510-4488-bb64-c5403a9c6bb7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:18.913369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a3e1f1a4-7510-4488-bb64-c5403a9c6bb7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:18.924165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a3e1f1a4-7510-4488-bb64-c5403a9c6bb7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1218 microversion: 2.1 time: 0.174492 Dec 16 17:55:18.937826 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 9/14] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:18 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:19.040891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:19.041607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:19.052401 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:19.060766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:19.061657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:19.062147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:19.683947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:19.704887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f82a7490-310c-4999-88ad-60a071ca9943 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1272 microversion: 2.1 time: 0.667737 Dec 16 17:55:19.716084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 6/15] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:19 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1272 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:19.944845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:19.946579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:19.954933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:19.955804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:19.957441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:19.958083 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:20.216157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7523e455-d171-48fa-be9e-04fa95b99516 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c4bd280>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:20.319041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7523e455-d171-48fa-be9e-04fa95b99516 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/05d3d7c9-f7c8-453c-afaf-72fda54f7647" status: 200 len: 349 microversion: 2.1 time: 0.106528 Dec 16 17:55:20.320010 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 7/16] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:55:20 2021] GET /compute/v2.1/os-volumes/05d3d7c9-f7c8-453c-afaf-72fda54f7647 => generated 349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:20.342245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-de303e12-9588-41ab-9cb8-b7bc97154e07 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1cd11ca0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:20.516139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:20.536138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d10434bb-a0a5-4374-a916-a0412482b638 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1214 microversion: 2.1 time: 0.595581 Dec 16 17:55:20.545411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-de303e12-9588-41ab-9cb8-b7bc97154e07 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210938 Dec 16 17:55:20.548075 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 10/17] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:19 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1214 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:20.559558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 8/18] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Dec 16 17:55:20 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:20.570448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-36e2413a-0964-4f6f-b550-b6314640b636 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c4b64c0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:20.735932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:20.738284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:20.751442 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:20.752248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:20.753574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:20.755423 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:20.809337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-36e2413a-0964-4f6f-b550-b6314640b636 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.242650 Dec 16 17:55:20.809907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 11/19] 10.222.0.32 () {58 vars in 1148 bytes} [Thu Dec 16 17:55:20 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:20.822970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0777896f-8f4c-45fe-a4e2-fe96fa601ba2 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c44d160>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:21.024733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0777896f-8f4c-45fe-a4e2-fe96fa601ba2 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.205800 Dec 16 17:55:21.027370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 12/20] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Dec 16 17:55:20 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:21.039018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-82910158-ddce-48ed-ad4e-3a198b67134f tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c4b6040>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:21.216387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-82910158-ddce-48ed-ad4e-3a198b67134f tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.181352 Dec 16 17:55:21.218749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 13/21] 10.222.0.32 () {58 vars in 1166 bytes} [Thu Dec 16 17:55:21 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:21.225113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:21.232476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5cde25fb-2870-447c-b787-6b30b7a66404 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c4b2550>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:21.236086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-20e6ae46-153b-4e9b-b139-ff7bc33102dc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1272 microversion: 2.1 time: 0.506114 Dec 16 17:55:21.240018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 9/22] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:20 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1272 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:21.564670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:21.565306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:21.576795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:21.577249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:21.578049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:21.591363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:21.773894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5cde25fb-2870-447c-b787-6b30b7a66404 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.545899 Dec 16 17:55:21.775013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 14/23] 10.222.0.32 () {58 vars in 1169 bytes} [Thu Dec 16 17:55:21 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:21.789221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-79f509f1-e7e3-433a-8cfb-2e9e58c948ab tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c4b2e50>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:21.984079 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-79f509f1-e7e3-433a-8cfb-2e9e58c948ab tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.200291 Dec 16 17:55:21.984878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 15/24] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Dec 16 17:55:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:21.999264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d52142ef-ab68-4c64-a872-212a840eb046 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c5198b0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:22.122189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:22.130161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-15f2aeb6-b949-4f2f-8659-ed9d7fe71362 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1270 microversion: 2.1 time: 0.570547 Dec 16 17:55:22.135424 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 10/25] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:21 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1270 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:22.186131 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d52142ef-ab68-4c64-a872-212a840eb046 tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.190963 Dec 16 17:55:22.187098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 16/26] 10.222.0.32 () {58 vars in 1187 bytes} [Thu Dec 16 17:55:21 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:22.198283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0f54caf2-5aa1-48e9-81d8-422db23fcfcc tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] Calling method '.version_select at 0x7fca1c475670>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:22.255851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:22.256763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:22.271727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:22.272506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:22.273523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:22.274128 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:22.751686 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0f54caf2-5aa1-48e9-81d8-422db23fcfcc tempest-VolumesTestJSON-946251056 tempest-VolumesTestJSON-946251056-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.556948 Dec 16 17:55:22.752584 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 11/27] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Dec 16 17:55:22 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:22.813204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:22.822503 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9e3018fb-e155-4a64-b2e0-f725231ac463 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1272 microversion: 2.1 time: 0.570365 Dec 16 17:55:22.833574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 17/28] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:22 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1272 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:23.153214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:23.154342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:23.169721 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:23.171294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:23.175762 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:23.180427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:23.674130 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:23.682488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8b775c79-2b0b-4ba7-b6f8-02c02dbfdb63 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1288 microversion: 2.1 time: 0.534291 Dec 16 17:55:23.686928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 12/29] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:23 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1288 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:23.850060 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:23.851026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:23.860569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:23.861043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:23.861892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:23.862336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:24.704395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:24.705699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:24.724466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:24.724914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:24.726243 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:24.728301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:24.794443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:24.808986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-249abfc2-d699-40f8-8b56-5fc9ce8034c3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.960233 Dec 16 17:55:24.809625 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 18/30] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:23 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:25.176879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:25.186553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-09b64af1-b168-4ed3-b499-8dc1d6286d74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1276 microversion: 2.1 time: 0.488854 Dec 16 17:55:25.203780 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 13/31] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:24 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1276 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:25.825653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:25.826313 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:25.844624 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:25.852168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:25.854455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:25.855272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:26.211341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:26.211989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:26.236548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:26.237244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:26.240039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:26.247252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:26.953204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:26.963701 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-547b1380-04c4-4e47-833f-018b20cae872 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1276 microversion: 2.1 time: 0.756610 Dec 16 17:55:26.966903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 14/32] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:26 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1276 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:27.282487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:27.290879 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b7753525-54d0-4786-9648-d785066cfb3f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 1.469100 Dec 16 17:55:27.299268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 19/33] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:25 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:27.986264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:27.996690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:28.008182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:28.008740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:28.009557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:28.010012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:28.296115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1732384223", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d273d2e6-faf5-44dc-9a35-a9f16d00a825"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:28.427726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] validate_networks() for [('d273d2e6-faf5-44dc-9a35-a9f16d00a825', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:55:29.461778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:29.473960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b6571a1b-43fd-4fff-b139-8977979b4eb9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 1.491317 Dec 16 17:55:29.474546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 20/34] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:27 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:29.486823 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:29.500505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:29.526654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:29.527848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:29.531997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:29.532673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:30.441162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:30.458065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-70c078d5-5b27-4273-837c-09fbf2190d65 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.979499 Dec 16 17:55:30.478720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 21/35] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:29 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:30.493235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:30.493870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:30.521110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:30.521569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:30.522384 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:30.529611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:31.123851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:31.132129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-497934b4-70b6-4653-9dc7-ddf5db842bb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.644830 Dec 16 17:55:31.134271 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 22/36] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:30 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:31.525389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: .version_select at 0x7fca1c411550>, body: {"keypair": {"name": "tempest-keypair-1258446672"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:31.556046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:31.563237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:31.820593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:31.827969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:31.870241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2880f2d6-5fa5-4c9f-9a1a-a3f3b19770f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.584577 Dec 16 17:55:31.871336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 23/37] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Dec 16 17:55:31 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:31.877551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:31.878246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:31.885350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:31.885946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:31.886860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:31.887787 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:32.609788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:32.627590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2d7191ef-84ba-4cf1-91eb-5009e078d5cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.754504 Dec 16 17:55:32.643801 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 24/38] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:31 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:32.663840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:32.668964 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:32.700559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:32.701010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:32.701855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:32.702290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:33.356504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:33.365546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f0663259-4a88-4b18-a63b-35aa11899dab tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.720375 Dec 16 17:55:33.368352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 25/39] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:32 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:33.831619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-922181fa-78b3-42c7-ae49-c52d4ba99281 req-11431772-6487-4927-a564-8db2478dba13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdae2178-d068-4d45-806d-87fc881b37dd", "tag": "6506aea0-64ec-479c-b87b-b1f8e1f05d52"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:33.836681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:33.836681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:55:33.865170 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-922181fa-78b3-42c7-ae49-c52d4ba99281 req-11431772-6487-4927-a564-8db2478dba13 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:33.866716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-922181fa-78b3-42c7-ae49-c52d4ba99281 req-11431772-6487-4927-a564-8db2478dba13 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:33.918475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-922181fa-78b3-42c7-ae49-c52d4ba99281 req-11431772-6487-4927-a564-8db2478dba13 service nova] Creating event network-changed:6506aea0-64ec-479c-b87b-b1f8e1f05d52 for instance bdae2178-d068-4d45-806d-87fc881b37dd on hv-cinder-81920 Dec 16 17:55:33.919361 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-922181fa-78b3-42c7-ae49-c52d4ba99281 req-11431772-6487-4927-a564-8db2478dba13 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 16 17:55:33.922375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:33.922935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:33.923791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:33.926635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:33.953219 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.compute.rpcapi [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 16 17:55:33.954975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] Releasing lock "compute-rpcapi-router" {{(pid=115914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 16 17:55:34.018332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-16aa69b6-9db9-4217-bbce-22b0e5ab51f7 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555610 Dec 16 17:55:34.019263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 26/40] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:34.028438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:34.029905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:34.048494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.050472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.051809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.055091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.111261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:55:34.111931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:55:34.112395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:55:34.112899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:55:34.113553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:55:34.127015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.127765 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.129263 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.130179 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.161694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Getting quotas for project de691ea87f0e4a4f947a9362feda9aaa. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:34.166846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Getting quotas for user fa51036d32ea408eb61e6c67985b695f and project de691ea87f0e4a4f947a9362feda9aaa. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:34.204793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:55:34.210089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:55:34.372111 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-41ad5bf4-c07a-4425-bed3-e0ef991c3805 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.414646 Dec 16 17:55:34.372775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 15/41] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:55:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 6416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:55:34.384030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e079ec26-7511-4a92-b5bc-64636155e397 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:34.386306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e079ec26-7511-4a92-b5bc-64636155e397 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:34.644263 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e079ec26-7511-4a92-b5bc-64636155e397 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:34.653451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e079ec26-7511-4a92-b5bc-64636155e397 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1222 microversion: 2.1 time: 0.274342 Dec 16 17:55:34.662129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 16/42] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:34 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:34.674114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:34.674800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:34.718598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.719154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.720015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:34.726883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:34.802776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:34.813324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b1c9063c-d5ba-4942-98ce-214cb93b8c54 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.792632 Dec 16 17:55:34.823134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 27/43] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:34 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:35.066863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490017689", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d273d2e6-faf5-44dc-9a35-a9f16d00a825"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:35.207070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] validate_networks() for [('d273d2e6-faf5-44dc-9a35-a9f16d00a825', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:55:35.671746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:35.683028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-036e98c9-efa4-49b8-be1c-7610eec74ac9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 1.020035 Dec 16 17:55:35.687460 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 17/44] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:34 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:35.841460 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:35.842250 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:35.863518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:35.867940 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:35.868996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:35.869445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:36.935063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:36.948548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-df4932ff-8c09-41a5-ae6f-8276be44cc83 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 1.110949 Dec 16 17:55:36.956649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 18/45] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:35 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:36.961444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-239dbcaa-9bb1-44d3-bc4e-02ff81c45c5a req-b66500e6-49ae-4825-a173-5e03f77aeaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0661c266-f8da-443a-81eb-4f6b894dd906", "tag": "16e14879-9e6e-4635-973a-9dd4e0786b26"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:36.963849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:36.963849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:55:36.986482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-239dbcaa-9bb1-44d3-bc4e-02ff81c45c5a req-b66500e6-49ae-4825-a173-5e03f77aeaab service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.001726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-239dbcaa-9bb1-44d3-bc4e-02ff81c45c5a req-b66500e6-49ae-4825-a173-5e03f77aeaab service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.043270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-239dbcaa-9bb1-44d3-bc4e-02ff81c45c5a req-b66500e6-49ae-4825-a173-5e03f77aeaab service nova] Creating event network-changed:16e14879-9e6e-4635-973a-9dd4e0786b26 for instance 0661c266-f8da-443a-81eb-4f6b894dd906 on hv-cinder-81920 Dec 16 17:55:37.050164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-239dbcaa-9bb1-44d3-bc4e-02ff81c45c5a req-b66500e6-49ae-4825-a173-5e03f77aeaab service nova] Acquired lock "compute-rpcapi-router" {{(pid=115915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 16 17:55:37.055614 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.056068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.056885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.057319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.088063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.compute.rpcapi [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 16 17:55:37.090656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] Releasing lock "compute-rpcapi-router" {{(pid=115915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 16 17:55:37.140984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ecfd01aa-d709-4cb1-97f7-93fc51020133 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182890 Dec 16 17:55:37.142154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 19/46] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:37.147453 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:37.149172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:37.167060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.170128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.171140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.171680 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.451453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:55:37.451869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:55:37.452328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:55:37.452900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:55:37.453477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:55:37.476325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.483863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.484847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.485299 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.525251 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Getting quotas for project de691ea87f0e4a4f947a9362feda9aaa. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:37.537639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Getting quotas for user fa51036d32ea408eb61e6c67985b695f and project de691ea87f0e4a4f947a9362feda9aaa. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:37.571065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:55:37.576104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:55:37.713135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a6221235-93de-4928-9070-e28cdce9d1e9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.650484 Dec 16 17:55:37.719646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 28/47] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:55:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:55:37.737092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c527a830-edbf-41b6-9b9d-52360eca7e62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:37.738184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c527a830-edbf-41b6-9b9d-52360eca7e62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:37.868695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c527a830-edbf-41b6-9b9d-52360eca7e62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:37.882723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c527a830-edbf-41b6-9b9d-52360eca7e62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1222 microversion: 2.1 time: 0.160838 Dec 16 17:55:37.901414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 29/48] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:37 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:37.957839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:37.965694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-389a5cfb-f5cc-4a83-9b29-019a11912ae1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.822091 Dec 16 17:55:37.969753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 20/49] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:37 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:37.970861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:37.971602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:37.984021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.988252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:37.989542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:37.990199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:38.579289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-367019905", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f239ba-5297-4276-aa7c-a1261d7cfa70"}], "security_groups": [{"name": "tempest-securitygroup--1148864245"}], "key_name": "tempest-keypair-1258446672", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:38.686409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:38.697627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1180fdd2-506e-498f-9b09-e5f98341595e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.734908 Dec 16 17:55:38.699880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 30/50] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:37 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:38.862035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] validate_networks() for [('43f239ba-5297-4276-aa7c-a1261d7cfa70', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:55:38.900169 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:38.901571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:38.912183 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:38.915036 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:38.916080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:38.919186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:39.272171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:39.285820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-699adb81-ab52-4222-9ba5-3130086a7281 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1274 microversion: 2.1 time: 0.389154 Dec 16 17:55:39.287557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 31/51] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:38 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1274 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:39.292557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:39.293394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:39.301646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:39.302506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:39.303571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:39.304151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:39.759981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:39.771246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5e63617a-d725-4701-9793-fea4238179fe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.481524 Dec 16 17:55:39.774508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 32/52] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:39 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:39.790489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:39.791168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:39.813534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:39.814483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:39.816519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:39.817292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.098789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:55:40.099343 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:55:40.100467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:55:40.104772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:55:40.105539 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:55:40.119828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.120383 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.123611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.124192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.143508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:55:40.156842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:55:40.169208 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:55:40.171719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:55:40.228314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5ef7a5b2-9cd0-4fb8-9acc-bb5613e2385d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.661535 Dec 16 17:55:40.228948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 21/53] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:55:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:55:40.239319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a23d51e7-6caf-45d2-9332-0f863e94467b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:40.240690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a23d51e7-6caf-45d2-9332-0f863e94467b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:40.312520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:40.315015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a23d51e7-6caf-45d2-9332-0f863e94467b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:40.321887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a23d51e7-6caf-45d2-9332-0f863e94467b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1237 microversion: 2.1 time: 0.086221 Dec 16 17:55:40.322321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-272b08d2-9619-4bb1-a569-fee68a4adc06 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.542180 Dec 16 17:55:40.325467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 22/54] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:40 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:40.331127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:40.331911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:40.333849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 33/55] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:39 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:40.348900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.349352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.350174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.350610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.421315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:40.430597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-06d71e75-8520-4866-9606-3f5689e2bbf4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1280 microversion: 2.1 time: 0.103754 Dec 16 17:55:40.431617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 23/56] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:40 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:40.791289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:40.792129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:40.802071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.804716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:40.807510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:40.807985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.115465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:41.123785 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a671c362-e0d6-4361-bd2c-fd237eb79938 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.337297 Dec 16 17:55:41.127153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 34/57] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:40 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:41.277621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-285eda03-f92a-4113-8e82-f3b77f8df47c req-454b8572-d4f9-4597-9bcc-60d38c90ded4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b128b8-90f3-4162-82d5-7b55358c2a7f", "tag": "290d5ebd-1bac-4c76-8c83-0bdc5ba08385"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:41.279633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:41.279633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:55:41.286536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-285eda03-f92a-4113-8e82-f3b77f8df47c req-454b8572-d4f9-4597-9bcc-60d38c90ded4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.287012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-285eda03-f92a-4113-8e82-f3b77f8df47c req-454b8572-d4f9-4597-9bcc-60d38c90ded4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.306944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-285eda03-f92a-4113-8e82-f3b77f8df47c req-454b8572-d4f9-4597-9bcc-60d38c90ded4 service nova] Creating event network-changed:290d5ebd-1bac-4c76-8c83-0bdc5ba08385 for instance 71b128b8-90f3-4162-82d5-7b55358c2a7f on hv-cinder-81920 Dec 16 17:55:41.312599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-285eda03-f92a-4113-8e82-f3b77f8df47c req-454b8572-d4f9-4597-9bcc-60d38c90ded4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180608 Dec 16 17:55:41.313706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 24/58] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:41.339921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:41.340799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:41.347907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.348362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.349187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.349803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.351106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:41.356684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:41.360223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.360669 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.361497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.361893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.415707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:41.424086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-102b2889-60ed-4661-8433-17f50d836637 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1241 microversion: 2.1 time: 0.088082 Dec 16 17:55:41.433678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 35/59] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:41 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:41.450435 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:41.451858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:41.460210 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.460997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.462371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:41.463410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:41.530630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:41.538409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a56a04dd-4863-4615-b5eb-f3b6499b70d0 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.192061 Dec 16 17:55:41.542037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 25/60] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:41 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:41.627058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:41.634788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-41202e3c-1379-4a99-970b-4856b3f3f5ed tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.189977 Dec 16 17:55:41.635787 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 36/61] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:41 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:42.140508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:42.141530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:42.148358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.148880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.149785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.150418 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.321556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:42.330761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4b563748-8d4e-48e9-b075-9eab8ee532e6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.194526 Dec 16 17:55:42.332368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 26/62] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:42 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:42.440636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:42.441809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:42.451179 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.451852 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.452782 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.453261 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.520225 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:42.529030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3120b980-c40d-47b9-a3c4-87436ef4c7cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1241 microversion: 2.1 time: 0.091973 Dec 16 17:55:42.530073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 37/63] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:42 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:42.558718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:42.559382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:42.566140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.567003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.568126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.568721 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.656488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:42.657715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:42.676858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.678151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.679005 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:42.679436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:42.787933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:42.802223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b6eed675-55bb-40f7-bd52-66a972100990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.248561 Dec 16 17:55:42.802964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 27/64] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:42 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:42.823064 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:42.830778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a4aa84e3-552c-4561-8295-2ed8c319645b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.181598 Dec 16 17:55:42.831605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 38/65] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:42 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:43.353154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:43.353772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:43.363802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.364250 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.365740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.366403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.552768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:43.553406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:43.560513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.561187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.561838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.562788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.615899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:43.625713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-edd7d5c9-c177-4277-8a35-04720e2c8ead tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.278012 Dec 16 17:55:43.636484 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 28/66] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:43 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:43.661214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:43.672767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fd1c5712-262c-49a8-a30d-4bcf70bf29b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1241 microversion: 2.1 time: 0.128484 Dec 16 17:55:43.673377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 39/67] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:43 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:43.819436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:43.820422 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:43.827408 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.828125 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.829315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.830043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.849444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:43.850071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:43.859089 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.859591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:43.870104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:43.870658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.064673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:44.068810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:44.076737 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-52e2c417-3c5a-4753-895d-1c5841ec2b62 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.231258 Dec 16 17:55:44.077482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0df7d34f-7b3f-4fdd-9260-d43d946d2838 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.261436 Dec 16 17:55:44.077805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 40/68] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:43 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:44.084243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-5f4bde7f-3141-4171-9ea7-8d25cf76c397 req-a117fc9a-3483-4626-8601-bb00776f360d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5e995c-4d16-4e48-ae00-73880432cf3c", "tag": "201a0fb1-09f4-4092-a321-78e56c800347"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:44.086435 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:44.086435 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:55:44.087066 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 29/69] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:43 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:44.103991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-5f4bde7f-3141-4171-9ea7-8d25cf76c397 req-a117fc9a-3483-4626-8601-bb00776f360d service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:44.104472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-5f4bde7f-3141-4171-9ea7-8d25cf76c397 req-a117fc9a-3483-4626-8601-bb00776f360d service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.119095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-5f4bde7f-3141-4171-9ea7-8d25cf76c397 req-a117fc9a-3483-4626-8601-bb00776f360d service nova] Creating event network-changed:201a0fb1-09f4-4092-a321-78e56c800347 for instance da5e995c-4d16-4e48-ae00-73880432cf3c on hv-cinder-81920 Dec 16 17:55:44.125195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-5f4bde7f-3141-4171-9ea7-8d25cf76c397 req-a117fc9a-3483-4626-8601-bb00776f360d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045492 Dec 16 17:55:44.125807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 41/70] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:55:44.642351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:44.643762 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:44.653471 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:44.654545 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.657012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:44.657594 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.691344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:44.692691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:44.704021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:44.705933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.708111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:44.709990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:44.913664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:44.921844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:44.927228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-765ee0a1-4e3a-4a35-b3a0-09a063e13453 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.288601 Dec 16 17:55:44.930286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 30/71] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:44 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:44.931401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1ee6c37d-c6af-4afc-884c-381402cdd45a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1233 microversion: 2.1 time: 0.244920 Dec 16 17:55:44.932607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 42/72] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:44 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1233 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:45.094216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:45.095267 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:45.105137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:45.106246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:45.120117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.121827 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.123054 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.124853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.126766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.127560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.128301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.128824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.788587 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:45.803011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7938fa4f-fe51-42b2-bccd-e6f61db227a9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.702299 Dec 16 17:55:45.805385 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 43/73] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:45 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:45.947544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:45.948997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:45.954143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:45.957985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.960297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.961932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:45.962393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:45.966191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6d517cfe-d690-4c8c-81aa-e0456ec5d881 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.876433 Dec 16 17:55:45.980335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 31/74] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:45 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:45.992322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:45.993124 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:46.007085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.007695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:46.008637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.009967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:46.148389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:46.156260 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1112b2be-c990-44fe-9729-be237a283b7e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1295 microversion: 2.1 time: 0.170649 Dec 16 17:55:46.156840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 32/75] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:45 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1295 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:46.286098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:46.298780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-78cfe62b-c5bd-4ffb-8974-a38339d9c7f3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.355471 Dec 16 17:55:46.299884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 44/76] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:45 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:46.824988 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:46.826789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:46.836598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.839154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:46.840195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.843439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:46.983668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:46.984526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:46.994208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.996488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:46.997668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:46.998337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:47.158442 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:47.166948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-58659654-fe34-481e-ab33-253f434e5efc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.348927 Dec 16 17:55:47.168314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 33/77] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:46 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:47.173395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:47.174551 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:47.181245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:47.181890 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:47.183585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:47.184578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:47.214105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:47.224729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c1bece87-d703-4f44-a19e-39363a84e1b6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.244624 Dec 16 17:55:47.226163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 45/78] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:46 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:47.276861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:47.286002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-854cb023-1b4c-40cf-8210-8eb66b81b472 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1295 microversion: 2.1 time: 0.116400 Dec 16 17:55:47.286580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 34/79] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:47 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:47.317410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:47.318397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:47.327309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:47.328103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:47.329429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:47.330124 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:47.624360 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:47.639194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-24a4f813-9524-4f73-8651-b76d64766652 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.327403 Dec 16 17:55:47.640038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 46/80] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:47 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:48.184250 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:48.184879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:48.191462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.192296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.193352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.193970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.243507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:48.244868 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:48.252167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.253108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.254104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.254704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.365810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:48.378826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-56371fb8-9865-4426-ba0a-4665bea3d04f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.194251 Dec 16 17:55:48.379981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 35/81] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:48 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:48.390658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:48.391855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:48.398098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.398668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.399696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.400313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.460895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:48.471595 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c5011c2c-519c-4fab-a478-56e5974eb438 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.231825 Dec 16 17:55:48.472789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 47/82] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:48 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:48.593325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:48.602363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5e734b4e-d8bf-4ae3-ad3e-d2c01369bac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.220652 Dec 16 17:55:48.603663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 36/83] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:48 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:48.657239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:48.658287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:48.668206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.668666 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.669704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:48.670467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:48.856831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:48.865386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-76bd3fba-b647-4c60-bd39-c0bc257e40a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.212656 Dec 16 17:55:48.866678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 48/84] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:48 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:49.396167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:49.396788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:49.403432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.404047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.405041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.405477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.488909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:49.489526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:49.495876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.496647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.497593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.498171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.588472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:49.597769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3cb234fb-7417-4a9f-82ae-403f4935d30c tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.205625 Dec 16 17:55:49.598358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 37/85] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:49 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:49.636737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:49.643244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:49.660739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.661354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.668562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.669023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.685155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:49.702007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-76e2dbf5-c5a5-4ba7-b52f-eb62e0a268c7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.216545 Dec 16 17:55:49.706656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 49/86] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:49 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:49.828532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:49.836236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1cc6bc91-7e4d-41b7-9ad6-f0a299aeb5a0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.220066 Dec 16 17:55:49.836835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 38/87] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:49 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:49.883401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:49.884000 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:49.891014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.891793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:49.892668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:49.893102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.060801 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:50.068745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0ff42377-4d26-4783-aa5b-8b77ea31a472 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.189077 Dec 16 17:55:50.069315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 50/88] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:49 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:50.617663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:50.618332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:50.630094 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.634517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.634517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.634517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.691941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-356efd17-ed82-4a52-81e8-3568760d7486 req-cd6fb27c-4670-442d-9464-630e313252e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6bc622-be3a-4c87-90e5-80f6bf9f4d39", "tag": "a7bb0c45-53de-4c29-97b7-aabce3e37a85"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:50.693547 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:50.693547 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:55:50.700872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-356efd17-ed82-4a52-81e8-3568760d7486 req-cd6fb27c-4670-442d-9464-630e313252e5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.701921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-356efd17-ed82-4a52-81e8-3568760d7486 req-cd6fb27c-4670-442d-9464-630e313252e5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.723636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-356efd17-ed82-4a52-81e8-3568760d7486 req-cd6fb27c-4670-442d-9464-630e313252e5 service nova] Creating event network-changed:a7bb0c45-53de-4c29-97b7-aabce3e37a85 for instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 on hv-cinder-81920 Dec 16 17:55:50.728850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-356efd17-ed82-4a52-81e8-3568760d7486 req-cd6fb27c-4670-442d-9464-630e313252e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041166 Dec 16 17:55:50.729853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 51/89] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:50.735383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:50.736093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:50.755506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.758047 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.760092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.760852 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.852503 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:50.859903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c03d1f3a-17e5-465b-91d4-47b7f4684aef tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.248425 Dec 16 17:55:50.861695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 39/90] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:50 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:50.866478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:50.867316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:50.876229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.876717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.877792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:50.878230 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:50.989078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:50.997619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4d65252b-faab-438e-aae1-a08ef0b7aff7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.266207 Dec 16 17:55:51.013270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 52/91] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:50 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:51.050783 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:51.059559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1e59d00d-a508-4d37-97bb-171a44809bf0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.196541 Dec 16 17:55:51.060193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 40/92] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:50 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:51.085257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:51.085888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:51.092277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:51.093081 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:51.093856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:51.094285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:51.244770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:51.256830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d137ed15-dd21-4fa6-b722-e5570ffc0517 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.175069 Dec 16 17:55:51.257835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 53/93] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:51 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:51.885142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:51.885872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:51.892589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:51.893073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:51.893925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:51.895334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.016231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:52.016869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:52.028162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.028849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.029459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.029894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.202824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:52.211356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d2624b10-def8-456b-8537-770d6c29624d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.198887 Dec 16 17:55:52.226988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 54/94] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:52 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:52.256802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:52.257429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:52.269150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:52.274203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.277258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-079e864a-2691-4561-9556-0e3cb4e97fbe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.402044 Dec 16 17:55:52.280620 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.281608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.282204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.286888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 41/95] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:51 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:52.292596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:52.293431 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:52.299991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.300429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.301342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:52.301926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:52.442792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:52.452099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-270373f9-5355-4c09-91df-b1652860997a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.223370 Dec 16 17:55:52.452687 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 55/96] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:52 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:52.573730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:52.584927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bdb05646-b891-4197-a1d8-ccda026c469d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.296657 Dec 16 17:55:52.585508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 42/97] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:52 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:53.288627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:53.289221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:53.295508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.295952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.296721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.297350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.298501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:53.299668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:53.308072 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.309075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.309879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.310363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.449690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:53.468766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1c0b2ca3-60a7-4544-9d8c-3241df38ee6d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.184137 Dec 16 17:55:53.470175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 56/98] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:53 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:53.479025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:53.484462 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:53.485140 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:53.488481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-29abd1ff-2cd9-467b-ab9d-86e01317bfbb tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.193917 Dec 16 17:55:53.491602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.492212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.493141 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.493569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.497827 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 43/99] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:53 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:53.602908 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:53.603945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:53.610118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.610772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.611734 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:53.612602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:53.639789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:53.646950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ec7cf4f5-6777-443c-9b39-39df84988304 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.175573 Dec 16 17:55:53.647512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 57/100] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:53 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:53.764409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:53.780171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a7e7e197-6e19-4eff-9a4b-f08f40c8bb84 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.182209 Dec 16 17:55:53.781204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 44/101] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:53 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:54.487399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:54.487988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:54.494207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.494781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.495574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.496102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.504913 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:54.505790 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:54.512350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.513243 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.515065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.515936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.642427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:54.657224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-89753aff-5281-44e0-bffa-77d7de5657dd tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.173552 Dec 16 17:55:54.658209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 58/102] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:54 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:54.668178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:54.668796 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:54.675198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.675649 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.676439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.676877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.679780 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:54.687947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4be43d6f-6a20-473c-bd65-8b29c69d4a6f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.187027 Dec 16 17:55:54.688529 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 45/103] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:54 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:54.799604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:54.800226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:54.806115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.806557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.807480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:54.808167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:54.821348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:54.829741 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-528211cb-2cf2-465e-b5e5-e6767b8c1a1c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.165340 Dec 16 17:55:54.830297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 59/104] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:54 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:54.943573 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:54.951515 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc000e1e-35e3-41bc-bb6f-cde55f314913 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.156186 Dec 16 17:55:54.952060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 46/105] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:54 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:55.674822 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:55.675414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:55.682395 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.683028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.683828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.684263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.704684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:55.705364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:55.711938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.712562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.713494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.714101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.860785 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:55.872043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-581c9f35-e7b6-4e3d-bae1-068f50de3b90 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.201854 Dec 16 17:55:55.872729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 60/106] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:55 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:55.878413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:55.879092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:55.885720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.886150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:55.886279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.888955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.889399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.895892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ebf6d65b-3cd5-40ff-858b-c96cf0e44853 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.194991 Dec 16 17:55:55.899396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 47/107] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:55 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:55.969305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:55.970186 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:55.977227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.977785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:55.978829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:55.979399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:56.039139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:56.048119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e81d6dbe-1c06-4b41-bb74-c7bf202aa7d2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.173867 Dec 16 17:55:56.048878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 61/108] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:55 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:56.131395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:56.139160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7ca24b05-6b33-4e2e-a25e-a55e6749157d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.174139 Dec 16 17:55:56.139764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 48/109] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:55 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:56.891109 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:56.891983 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:56.900278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:56.900836 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:56.901670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:56.902106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:56.911959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:56.912649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:56.918944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:56.919463 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:56.920335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:56.920819 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.061337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:57.070564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-69acecdf-22cd-4a53-8ebf-db32b0f9ed49 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.185309 Dec 16 17:55:57.071356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 62/110] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:56 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:57.076833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:57.077445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:57.090512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:57.091208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.092927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:57.093546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.129781 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:57.143028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-90449966-9b03-4880-b4c0-243b9bc534c7 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.234621 Dec 16 17:55:57.144366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 49/111] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:56 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:57.159365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:57.160015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:57.167047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:57.167986 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.169269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:57.169887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.246207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:57.256335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9eb3a5fd-2809-4d1d-8d5a-e96e61db81d1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.183341 Dec 16 17:55:57.256808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 63/112] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:57 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:57.345093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:57.352656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-40da8e42-6064-40c1-bf2d-b9161067c409 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.197855 Dec 16 17:55:57.362607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 50/113] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:57 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:57.512845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-ee1d717c-6986-454c-8a8e-0d6be55ec561 req-40c00bba-f214-407a-b9e0-2eb8574244b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0661c266-f8da-443a-81eb-4f6b894dd906", "name": "network-vif-plugged", "status": "completed", "tag": "16e14879-9e6e-4635-973a-9dd4e0786b26"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:57.514684 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:57.514684 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:55:57.522343 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-ee1d717c-6986-454c-8a8e-0d6be55ec561 req-40c00bba-f214-407a-b9e0-2eb8574244b2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:57.522981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-ee1d717c-6986-454c-8a8e-0d6be55ec561 req-40c00bba-f214-407a-b9e0-2eb8574244b2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:57.535532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-ee1d717c-6986-454c-8a8e-0d6be55ec561 req-40c00bba-f214-407a-b9e0-2eb8574244b2 service nova] Creating event network-vif-plugged:16e14879-9e6e-4635-973a-9dd4e0786b26 for instance 0661c266-f8da-443a-81eb-4f6b894dd906 on hv-cinder-81920 Dec 16 17:55:57.542092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-ee1d717c-6986-454c-8a8e-0d6be55ec561 req-40c00bba-f214-407a-b9e0-2eb8574244b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161262 Dec 16 17:55:57.546952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 64/114] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:58.090873 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:58.090873 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:58.095934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.096395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.098446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.098446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.160293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:58.161152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:58.167993 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.168550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.169306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.169667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.244008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:58.252883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-12c11824-5d49-4b13-b0b7-7d27dfad4bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.168423 Dec 16 17:55:58.254395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 51/115] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:58 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:58.273562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:58.274204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:58.280856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.281500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.282438 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.282904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.311251 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:58.320080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6af86d47-ba6b-4404-af76-e11dab4d306f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.163732 Dec 16 17:55:58.320799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 65/116] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:58 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:58.369698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:58.370580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:58.377441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.378029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.379602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:58.380184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:58.437052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:58.444751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d9f7807a-d40a-42d6-98de-5b73e82c0aaf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.175194 Dec 16 17:55:58.445332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 52/117] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:58 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:58.543160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:58.550921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c26b24ed-37d0-4f49-8779-2d0b557c95af tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.185341 Dec 16 17:55:58.551472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 66/118] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:58 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:59.271893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:59.272518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:59.279607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.280082 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.280899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.281330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.340145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:59.340843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:59.347674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.348192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.349069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.349568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.432702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:59.440391 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1a4c3ed1-e765-4824-918f-6819b76ae9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.172261 Dec 16 17:55:59.450189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 53/119] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:59 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:59.461123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:59.461815 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:59.468959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.469474 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.470308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.470852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.485143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:59.492459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-436d7e22-b47b-4155-a821-d183054d47fe tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.157588 Dec 16 17:55:59.493027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 67/120] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:59 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:55:59.563807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-97fec1b3-dcfa-46db-9d39-22b1c221fd68 req-16b719e2-fc25-4c9e-9992-eb715ee9c686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdae2178-d068-4d45-806d-87fc881b37dd", "name": "network-vif-plugged", "status": "completed", "tag": "6506aea0-64ec-479c-b87b-b1f8e1f05d52"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:55:59.565444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:55:59.565444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:55:59.572882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-97fec1b3-dcfa-46db-9d39-22b1c221fd68 req-16b719e2-fc25-4c9e-9992-eb715ee9c686 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.573426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-97fec1b3-dcfa-46db-9d39-22b1c221fd68 req-16b719e2-fc25-4c9e-9992-eb715ee9c686 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.584394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-97fec1b3-dcfa-46db-9d39-22b1c221fd68 req-16b719e2-fc25-4c9e-9992-eb715ee9c686 service nova] Creating event network-vif-plugged:6506aea0-64ec-479c-b87b-b1f8e1f05d52 for instance bdae2178-d068-4d45-806d-87fc881b37dd on hv-cinder-81920 Dec 16 17:55:59.590286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-97fec1b3-dcfa-46db-9d39-22b1c221fd68 req-16b719e2-fc25-4c9e-9992-eb715ee9c686 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030139 Dec 16 17:55:59.590968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 68/121] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:55:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:55:59.596054 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:55:59.596757 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:55:59.602806 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.603203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.604708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:55:59.605146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:55:59.605445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:59.612826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4a4daf56-8f26-42ac-aa82-df15c83388a7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.155363 Dec 16 17:55:59.613435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 54/122] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:59 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:55:59.760485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:55:59.769821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-980cac10-f44c-435d-a110-0cb2b656415d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.177341 Dec 16 17:55:59.770955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 69/123] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:55:59 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:00.458930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:00.459777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:00.467464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.468253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.469095 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.469722 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.518648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:00.519296 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:00.525467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.526054 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.526882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.527308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.646956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:00.655041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5cfa63a8-b849-4d5d-8b05-8afbea13234f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.200242 Dec 16 17:56:00.655791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 55/124] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:00 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:00.660349 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:00.660936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:00.671201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.671906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.673035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.673144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.678041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:00.686797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7b1fed1b-43aa-43ea-a96d-1aaad2dd920f tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.180333 Dec 16 17:56:00.687464 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 70/125] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:00 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:00.787463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:00.788160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:00.793972 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.794467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.795409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:00.795977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:00.818320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:00.826190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b0e0bc4a-4cba-4577-bb91-7079d368baf8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.169185 Dec 16 17:56:00.828348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 56/126] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:00 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:00.929470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:00.937644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c1f95f87-93f2-4751-b546-e3f96947c422 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.153762 Dec 16 17:56:00.938237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 71/127] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:00 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:01.672143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:01.672777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:01.679161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.679619 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.680459 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.680905 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.704182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:01.704954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:01.711430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.711880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.712671 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.713082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.829302 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:01.837447 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fb923c31-33ae-478c-81ac-2735a330982f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.168742 Dec 16 17:56:01.837841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 57/128] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:01 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:01.852204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:01.852824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:01.859374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.859814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.860596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.861015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.861451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:01.868766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b989db3d-3dec-4544-8afd-504e5cbeaaed tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.168566 Dec 16 17:56:01.878468 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 72/129] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:01 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:01.954026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:01.954869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:01.963546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.964467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:01.965618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:01.966284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:02.032481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:02.048417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-46598732-efff-4b29-8d07-4db225b29c4a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.194730 Dec 16 17:56:02.049654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 58/130] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:01 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:02.145051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:02.153905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-747ef715-64b7-4f80-b6d6-8a8001e9eb15 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.203569 Dec 16 17:56:02.154710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 73/131] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:01 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:02.854683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:02.855894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:02.862300 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:02.862912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:02.868281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:02.868785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:02.885144 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:02.885718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:02.891850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:02.892732 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:02.893566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:02.893914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:03.028329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:03.036447 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0f864f79-b138-470f-9a73-7df1e1523f7e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.185399 Dec 16 17:56:03.048178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 59/132] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:02 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:03.049714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:03.060804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f50d12a5-2e6e-4514-9a6c-d11abc7a07b9 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.178767 Dec 16 17:56:03.061416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 74/133] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:02 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:03.065493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:03.066298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:03.076696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:03.077147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:03.077949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:03.078379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:03.171024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:03.171610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:03.177587 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:03.178270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:03.179126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:03.179572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:03.229144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:03.237236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3444e411-a066-416d-976d-2f7d9e1b1752 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.175464 Dec 16 17:56:03.238666 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 60/134] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:03 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:03.332528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:03.340909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1c724038-ecce-4bb5-a1ec-d3bea8434fb2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.173856 Dec 16 17:56:03.341518 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 75/135] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:03 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:04.058226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:04.059665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:04.066268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.067234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.068600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.069242 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.079464 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:04.080481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:04.087467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.097177 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.098367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.098990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.249918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:04.259558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-42835667-ad65-4898-be02-e411e506ae75 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.208849 Dec 16 17:56:04.260123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 61/136] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:04 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:04.270365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:04.271002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:04.277628 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.278743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.279022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.279599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.351077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:04.365294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6e21b963-efff-4066-9c4e-1204f8e1fc23 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.291284 Dec 16 17:56:04.366145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 76/137] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:04 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:04.380442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:04.381137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:04.387553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.388121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.388986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:04.389468 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:04.484814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:04.493345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e6ea0339-b31d-432f-9711-7b32d78c7057 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.232008 Dec 16 17:56:04.494638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 62/138] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:04 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:04.568789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:04.580656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0d033f69-a5f8-4671-8a19-9f0889cd45c3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.212749 Dec 16 17:56:04.581238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 77/139] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:04 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:05.279752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:05.281692 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:05.298108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.298554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.299794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.300224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.384004 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:05.384610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:05.404123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.404606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.405434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.405867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.475747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:05.484303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-092bea12-cc03-49c8-ab25-db61ff39dd1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.210121 Dec 16 17:56:05.485470 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 63/140] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:05 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:05.509696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:05.510504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:05.517451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.518149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.519147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.519758 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.571759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:05.581205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f7e7914e-cde1-4af0-8bd2-3b6669be0990 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.201777 Dec 16 17:56:05.581828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 78/141] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:05 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:05.597632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:05.598307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:05.604805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.605932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.606633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:05.607202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:05.694407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:05.705542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3105e73a-6f11-40b2-8512-9f2ebf14cec5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.199255 Dec 16 17:56:05.706413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 64/142] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:05 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:05.744921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:05.758583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-67379036-4bbf-4282-82fe-ed92b1e77fa8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.164768 Dec 16 17:56:05.759227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 79/143] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:05 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:06.501355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:06.502003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:06.509221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.509920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.510973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.511608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.601202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:06.601955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:06.616880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.619086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.620436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.621761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.676919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:06.686203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f26bdb45-4e18-43f6-8a7c-8f03f58c6eb3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.188732 Dec 16 17:56:06.687021 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 65/144] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:06 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:06.726176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:06.727215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:06.738568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.739291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.740277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.740714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.802835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:06.812055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3bfece37-ab83-4d5a-ae50-3e5d35e416df tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.216948 Dec 16 17:56:06.822984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 80/145] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:06 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:06.828837 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:06.829813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:06.836673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.837112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.838153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:06.838817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:06.923627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:06.931168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-77c6b5de-0430-4c99-b47e-105419178c8a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.210192 Dec 16 17:56:06.931742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 66/146] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:06 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:07.004657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:07.012851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-380ed0ed-0d6c-4765-9bbc-d5c65e652597 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.188348 Dec 16 17:56:07.013436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 81/147] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:06 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:07.704183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:07.704933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:07.711434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.711786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:07.712564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.712989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:07.830319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:07.831148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:07.837207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.837655 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:07.838440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.838896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:07.857281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:07.868240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-87b83d19-53e4-477b-84c8-e41b4e7f699f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.168515 Dec 16 17:56:07.869049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 67/148] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:07 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:07.949568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:07.951471 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:07.958264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.958816 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:07.959836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:07.960455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:08.008350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:08.034086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cfa16e7b-3a49-41df-a796-f1b2ada08aa3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.208388 Dec 16 17:56:08.044087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 82/149] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:07 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:08.049962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:08.050693 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:08.059336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:08.059748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:08.060543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:08.060978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:08.128841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:08.137964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-daa6096b-853f-4654-9863-deb849d2406d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.193558 Dec 16 17:56:08.139843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 68/150] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:07 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:08.145303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-1c2fea03-1d7a-444c-988f-e728ca59dd01 req-c7f6758a-f485-4062-b881-f7e9a085c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5e995c-4d16-4e48-ae00-73880432cf3c", "name": "network-vif-plugged", "status": "completed", "tag": "201a0fb1-09f4-4092-a321-78e56c800347"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:08.148400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:08.148400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:56:08.162924 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1c2fea03-1d7a-444c-988f-e728ca59dd01 req-c7f6758a-f485-4062-b881-f7e9a085c1a6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:08.163587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1c2fea03-1d7a-444c-988f-e728ca59dd01 req-c7f6758a-f485-4062-b881-f7e9a085c1a6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:08.179837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-1c2fea03-1d7a-444c-988f-e728ca59dd01 req-c7f6758a-f485-4062-b881-f7e9a085c1a6 service nova] Creating event network-vif-plugged:201a0fb1-09f4-4092-a321-78e56c800347 for instance da5e995c-4d16-4e48-ae00-73880432cf3c on hv-cinder-81920 Dec 16 17:56:08.185925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-1c2fea03-1d7a-444c-988f-e728ca59dd01 req-c7f6758a-f485-4062-b881-f7e9a085c1a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044434 Dec 16 17:56:08.186860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 69/151] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:08.248591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:08.256038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f370bd2f-7a8e-4152-b8ca-e749b859b29f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.211039 Dec 16 17:56:08.265418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 83/152] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:08 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:08.885880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:08.886646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:08.893382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:08.893832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:08.894632 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:08.895078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.054658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:09.055406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:09.062170 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.062730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.063514 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.063936 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.094140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:09.102283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-54a7166e-712f-4124-b24f-d3f85209d93b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.220581 Dec 16 17:56:09.102892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 70/153] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:08 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:09.156544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:09.157140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:09.163198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.163684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.164444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.164868 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.205227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:09.212939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f706ee70-e53b-4eaa-8787-02867243d47e tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1314 microversion: 2.1 time: 0.164854 Dec 16 17:56:09.213591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 84/154] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:09 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:09.273304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:09.274114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:09.285644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.286161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.287114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:09.287544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:09.309754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:09.317269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9fa42a4b-33cd-4fff-bfc2-6306e5a13601 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.165968 Dec 16 17:56:09.326437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 71/155] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:09 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:09.432525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:09.442345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a7e047d8-9917-4c62-8cdf-e3183ecf405e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1318 microversion: 2.1 time: 0.173550 Dec 16 17:56:09.451473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 85/156] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:09 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:10.120421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:10.121066 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:10.127717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.128183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.128945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.129587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.204610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-be90b14c-52a1-42bd-9ecb-0817caf3094a req-0242e5c0-c5fe-47db-9dcf-1ec03f89149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b128b8-90f3-4162-82d5-7b55358c2a7f", "name": "network-vif-plugged", "status": "completed", "tag": "290d5ebd-1bac-4c76-8c83-0bdc5ba08385"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:10.206522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:10.206522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:56:10.216454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-be90b14c-52a1-42bd-9ecb-0817caf3094a req-0242e5c0-c5fe-47db-9dcf-1ec03f89149f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.216902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-be90b14c-52a1-42bd-9ecb-0817caf3094a req-0242e5c0-c5fe-47db-9dcf-1ec03f89149f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.230910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-be90b14c-52a1-42bd-9ecb-0817caf3094a req-0242e5c0-c5fe-47db-9dcf-1ec03f89149f service nova] Creating event network-vif-plugged:290d5ebd-1bac-4c76-8c83-0bdc5ba08385 for instance 71b128b8-90f3-4162-82d5-7b55358c2a7f on hv-cinder-81920 Dec 16 17:56:10.239239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-be90b14c-52a1-42bd-9ecb-0817caf3094a req-0242e5c0-c5fe-47db-9dcf-1ec03f89149f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 Dec 16 17:56:10.240255 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 86/157] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:10.246184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:10.246921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:10.253284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.253724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.254508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.254949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.270661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:10.281443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0ae59d6a-925b-4dbb-b195-0aec1455a7cf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.164722 Dec 16 17:56:10.291290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 72/158] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:10 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:10.334068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:10.335404 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:10.343476 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.344449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.346028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.346690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.424797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:10.440356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-39b55e09-df16-4a51-a0df-dc1096e3b40b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1501 microversion: 2.1 time: 0.198687 Dec 16 17:56:10.442730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 87/159] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:10 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:10.467065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:10.468439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:10.477842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.479136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.480482 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:10.481152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:10.543526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:10.552217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0241a4f2-5aec-4b15-92e1-1038d4ec050b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.221986 Dec 16 17:56:10.562775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 73/160] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:10 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:10.672300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:10.680755 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2c86d320-1a68-4e40-bead-0ab3e9071473 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1507 microversion: 2.1 time: 0.219812 Dec 16 17:56:10.693032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 88/161] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:10 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:11.297893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:11.298511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:11.304340 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.304778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:11.305556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.305985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:11.452562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:11.460395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-311769b3-2929-4d2c-a4b3-0cde7daba347 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1322 microversion: 2.1 time: 0.166345 Dec 16 17:56:11.461182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 74/162] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:11 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:11.570042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:11.570728 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:11.577055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.577560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:11.581928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.581928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:11.729450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:11.740563 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-911b2dd6-b7bb-4905-a1e2-894a22d4d26f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.174443 Dec 16 17:56:11.741412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 89/163] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:11 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:11.928706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87784786-d0cf-4d65-8ac5-61d284cb7c5d"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:11.930192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:11.938767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.939666 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:11.940711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:11.941359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.260410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-75128044-6f48-4590-8d82-f1482dfc2ed5 req-588d2730-38fe-422b-946b-ed3b38fc1c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6bc622-be3a-4c87-90e5-80f6bf9f4d39", "name": "network-vif-plugged", "status": "completed", "tag": "a7bb0c45-53de-4c29-97b7-aabce3e37a85"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:12.262326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:12.262326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:56:12.271134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75128044-6f48-4590-8d82-f1482dfc2ed5 req-588d2730-38fe-422b-946b-ed3b38fc1c99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.271771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75128044-6f48-4590-8d82-f1482dfc2ed5 req-588d2730-38fe-422b-946b-ed3b38fc1c99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.291318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-75128044-6f48-4590-8d82-f1482dfc2ed5 req-588d2730-38fe-422b-946b-ed3b38fc1c99 service nova] Creating event network-vif-plugged:a7bb0c45-53de-4c29-97b7-aabce3e37a85 for instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 on hv-cinder-81920 Dec 16 17:56:12.297332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-75128044-6f48-4590-8d82-f1482dfc2ed5 req-588d2730-38fe-422b-946b-ed3b38fc1c99 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040501 Dec 16 17:56:12.298444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 90/164] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:56:12.479002 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:12.480222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:12.487333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.487853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.488646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.489116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.504615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b6deb814-fa81-4e13-a30f-c3b94e2ced67 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "POST /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580135 Dec 16 17:56:12.506206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 75/165] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:56:11 2021] POST /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:12.673615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:12.680753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-53a2ea25-47e4-4e49-8daf-6bb82961889b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1517 microversion: 2.1 time: 0.205905 Dec 16 17:56:12.681316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 91/166] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:12 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:12.700421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:12.701535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:12.709481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.709943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.710818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.711322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.738499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lazy-loading 'flavor' on Instance uuid da5e995c-4d16-4e48-ae00-73880432cf3c {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:56:12.758726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:12.759345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:12.765657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.766332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.767383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.767813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.881462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f46febd1-48e7-432f-b970-5a640e190294 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c/action" status: 200 len: 32 microversion: 2.1 time: 0.185737 Dec 16 17:56:12.882075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 76/167] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:12 2021] POST /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:12.892002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:12.892716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:12.899388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.899837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.900631 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:12.901065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:12.926486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:12.934740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d588ee71-3eac-40ae-98d0-139fe28bfa37 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.181140 Dec 16 17:56:12.936360 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 92/168] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:12 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:13.059804 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:13.068189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-919c44ef-48ee-4ed7-9788-71424f56a3f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.180321 Dec 16 17:56:13.068768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 77/169] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:12 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:13.307041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d756caf-3996-4cdb-b08b-b87c0b4939c4"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:13.308110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:13.314231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:13.314731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:13.315505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:13.315938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:13.955379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:13.956294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:13.966607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:13.967089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:13.968195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:13.968623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:14.117231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:14.128896 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b9f10991-e3f2-4b24-9b81-7ca30841c53b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.178617 Dec 16 17:56:14.129653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 78/170] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:13 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:14.136554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:14.137337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:14.146941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:14.147676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:14.148945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:14.149673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:14.309594 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:14.317592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-803731a6-c7c5-4cdd-88fc-bab2285c2fa2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.186714 Dec 16 17:56:14.318168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 79/171] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:14 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:15.153904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:15.154560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:15.161719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:15.162245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:15.163330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:15.163813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:15.322750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:15.330700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e98a94b3-dc90-4d3b-8aec-41286a4673f7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.182301 Dec 16 17:56:15.331320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 80/172] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:15 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:15.335631 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:15.336231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:15.342329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:15.343153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:15.343959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:15.344394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:15.482215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:15.490152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7499439a-632b-4613-a481-f73dc32667ad tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.157899 Dec 16 17:56:15.490761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 81/173] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:15 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:16.351159 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:16.352073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:16.362826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:16.363530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:16.364807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:16.365515 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:16.506294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:16.514205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-46dc4563-7484-42b5-b8b0-b07e4bae1bbf tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.168960 Dec 16 17:56:16.514857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 82/174] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:16 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:16.520889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:16.521488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:16.527771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:16.528221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:16.528983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:16.529411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:16.661997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:16.669846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c86c462f-6e00-44c2-9046-f9482d7615cb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.154014 Dec 16 17:56:16.670418 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 83/175] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:16 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:17.536751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:17.537708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:17.546261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:17.546727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:17.547499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:17.547921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:17.689063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:17.701341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9fd14f5e-0243-4117-a1d7-ca73d7431d00 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.170560 Dec 16 17:56:17.702183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 84/176] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:17 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:17.708626 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:17.709605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:17.718246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:17.718736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:17.719522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:17.719957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:17.872919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:17.880705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3f1d456a-9dda-4cc8-b86a-92a3893920bc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.177172 Dec 16 17:56:17.881266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 85/177] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:17 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:18.723428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:18.724051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:18.730662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:18.731122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:18.732191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:18.732623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:18.869064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:18.881346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-16aa518e-d635-4be6-b609-d9bcc8b8a6dd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.161387 Dec 16 17:56:18.882305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 86/178] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:18 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:18.897779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:18.898417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:18.904430 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:18.904878 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:18.905662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:18.906128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:19.045804 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:19.054013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-94f888eb-9d62-494b-ba46-fd01b50b1e41 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.160304 Dec 16 17:56:19.054593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 87/179] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:18 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:19.483642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-54d01151-10b0-499f-9c40-08f99e99cd74 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.180113 Dec 16 17:56:19.484287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 93/180] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:56:13 2021] POST /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments => generated 194 bytes in 6182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:19.901786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:19.902400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:19.909417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:19.909863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:19.910662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:19.911141 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:20.052713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:20.061462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2543d416-9bec-4046-b654-bd5e55daefdb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.162163 Dec 16 17:56:20.061462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 88/181] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:19 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:20.072052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:20.072817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:20.079641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:20.080087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:20.080879 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:20.081341 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:20.219470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:20.227016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1364817a-ae3c-4a27-ae7f-7e06174ae612 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.159523 Dec 16 17:56:20.227594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 94/182] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:20 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:21.076083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:21.076690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:21.083482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:21.084154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:21.084944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:21.085380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:21.227916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:21.236492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-33a84f95-6649-4d81-9c31-264787cb0a51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.164175 Dec 16 17:56:21.237033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 89/183] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:21 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:21.243779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:21.244392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:21.250955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:21.251404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:21.252174 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:21.252603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:21.387586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:21.396132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-08e57c6e-6544-497d-bbea-dfdd25ff3c37 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.155946 Dec 16 17:56:21.396733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 95/184] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:21 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:22.256618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:22.257636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:22.268272 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:22.269065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:22.270409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:22.271195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:22.414074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:22.417792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:22.418802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:22.424992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a65d5604-8395-4255-ae94-05413b9a69ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.174435 Dec 16 17:56:22.425598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 90/185] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:22 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:22.428326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:22.429040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:22.430303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:22.431092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:22.580848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:22.588656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-772c7407-217a-44d4-8fae-5e0aa4e42693 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.176678 Dec 16 17:56:22.589202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 96/186] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:22 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:23.447973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:23.448543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:23.456170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:23.456634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:23.457413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:23.457847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:23.605969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:23.609592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:23.610243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:23.614144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cfc80da7-4bec-40d2-adfb-b7190eb71c2f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.171390 Dec 16 17:56:23.614924 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 91/187] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:23 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:23.616777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:23.617238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:23.618015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:23.618450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:23.754828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:23.762915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-57ae97cb-ea9a-4153-a615-6b99b0690a29 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.157741 Dec 16 17:56:23.763902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 97/188] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:23 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:24.633542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:24.634139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:24.641292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:24.641720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:24.642829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:24.643246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:24.779931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:24.780216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:24.780870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:24.787268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:24.788014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:24.789008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:24.789855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:24.790359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dc89acb2-bca3-4c63-9407-e901d7dd48ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.160444 Dec 16 17:56:24.791536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 92/189] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:24 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:25.074505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:25.082424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d0de1429-1edb-4718-9035-4c409ac89059 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.306078 Dec 16 17:56:25.083027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 98/190] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:24 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:25.807172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:25.808421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:25.815473 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:25.815920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:25.816727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:25.817163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:25.969826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:25.977284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-45eba1ea-a7b0-4270-b4b8-1c2c0bda93e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1363 microversion: 2.1 time: 0.173848 Dec 16 17:56:25.977846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 93/191] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:25 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:26.099783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:26.101546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:26.108632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:26.109591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:26.110418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:26.110889 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:26.248522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:26.256172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1abb6f07-9621-4229-88c9-ffeaede933a3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.160809 Dec 16 17:56:26.256739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 99/192] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:26 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:26.993910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:26.995047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:27.007002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.007445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.008234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.008663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.145662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:27.153742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-be219e0d-db18-4859-be0a-f67f599022e6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1548 microversion: 2.1 time: 0.163779 Dec 16 17:56:27.154599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 94/193] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:26 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:27.172407 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:27.173542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:27.180332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.180842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.181676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.182132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.275468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:27.276293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:27.284570 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.285020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.285805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:27.286275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:27.287929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2bf049e6-6dcc-4a9f-bca5-f54f3888b4bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119778 Dec 16 17:56:27.290771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 100/194] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Dec 16 17:56:27 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:27.679124 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:27.687800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-855fde4e-2eb4-4d06-8108-d08112f3018a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.417866 Dec 16 17:56:27.688391 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 95/195] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:27 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:28.708302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:28.708944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:28.728818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:28.728818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:28.728818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:28.728818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:28.929953 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:28.939723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c8a2d07a-559c-4637-b4e5-5c2d5959f001 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.238927 Dec 16 17:56:28.940926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 101/196] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:28 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:29.009712 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:29.010329 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-b41ec64d-15c3-44ea-a60f-cf373a1f4b93 req-dbb8cc9e-9ab0-45c2-8e0c-c492987759a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6bc622-be3a-4c87-90e5-80f6bf9f4d39", "tag": "a7bb0c45-53de-4c29-97b7-aabce3e37a85"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:29.011512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:29.012178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:29.012178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:56:29.019897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b41ec64d-15c3-44ea-a60f-cf373a1f4b93 req-dbb8cc9e-9ab0-45c2-8e0c-c492987759a5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:29.020332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b41ec64d-15c3-44ea-a60f-cf373a1f4b93 req-dbb8cc9e-9ab0-45c2-8e0c-c492987759a5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:29.025252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:29.025709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:29.026513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:29.030145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:29.033171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-b41ec64d-15c3-44ea-a60f-cf373a1f4b93 req-dbb8cc9e-9ab0-45c2-8e0c-c492987759a5 service nova] Creating event network-changed:a7bb0c45-53de-4c29-97b7-aabce3e37a85 for instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 on hv-cinder-81920 Dec 16 17:56:29.039108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-b41ec64d-15c3-44ea-a60f-cf373a1f4b93 req-dbb8cc9e-9ab0-45c2-8e0c-c492987759a5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032300 Dec 16 17:56:29.040033 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 102/197] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:29.165385 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a915bbd8-992d-4e22-aefa-db0019e97698 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.161566 Dec 16 17:56:29.169993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 96/198] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:29 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:29.958070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:29.959000 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:29.975840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:29.976520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:29.977882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:29.980334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:30.149547 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:30.157909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d660b6ac-0470-4ef7-971a-862040e1852e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.204363 Dec 16 17:56:30.158525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 103/199] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:29 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:30.178476 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:30.179547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:30.187520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:30.188263 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:30.189766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:30.190287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:30.269470 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-748a3abb-50c0-47e3-8fe1-eb4f46f26bc8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.095205 Dec 16 17:56:30.272873 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 97/200] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:30 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:31.175063 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:31.175661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:31.184477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:31.184951 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:31.185952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:31.186422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:31.289020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:31.291728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:31.311110 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:31.311770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:31.314057 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:31.317567 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:31.362579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:31.381726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-631c64fd-32b0-477f-8af6-3b19f2a0345c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.210462 Dec 16 17:56:31.387127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 104/201] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:31 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:31.470257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f8494a97-5810-43b1-8703-82c4c6d96e4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.192117 Dec 16 17:56:31.471274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 98/202] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:31 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:32.403434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:32.404160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:32.412340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:32.413009 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:32.414060 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:32.414653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:32.483583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:32.484923 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:32.492576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:32.493887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:32.495135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:32.495725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:32.585952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e9d8a74e-220a-4335-8c57-0a8b4c8d7fe4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.106894 Dec 16 17:56:32.586780 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 99/203] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:32 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:32.657977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:32.669177 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7ae1d646-2f4b-4590-b756-e20707da271b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.269823 Dec 16 17:56:32.670443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 105/204] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:32 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:33.601900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:33.603409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:33.614406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:33.615079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:33.616488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:33.617321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:33.685187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:33.685925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:33.692668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:33.693329 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:33.694123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:33.694528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:33.721214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b585fe81-2d40-48be-8fe6-00ec3eadf25f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.123935 Dec 16 17:56:33.722763 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 100/205] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:33 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:33.874367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:33.884344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-371ed9a9-23a3-4aca-a056-b537f8ca9e66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.202737 Dec 16 17:56:33.885004 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 106/206] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:33 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:34.733086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:34.734489 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:34.741207 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:34.741650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:34.742496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:34.742911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:34.828897 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2288b941-ba14-4ecb-b56e-934001475f55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.099151 Dec 16 17:56:34.829736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 101/207] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:34 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:34.902166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:34.902839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:34.909623 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:34.910072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:34.910901 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:34.911339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:35.084648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:35.093358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-482bd404-81b3-46bc-8b14-d29f04fe36b4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.195615 Dec 16 17:56:35.094206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 107/208] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:34 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:35.844543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:35.848491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:35.853246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:35.853804 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:35.854677 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:35.855174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:35.924620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-557046be-5c25-4c60-b536-8e9cf50f50ce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.086287 Dec 16 17:56:35.927776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 102/209] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:35 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:36.112061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:36.112592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:36.119312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.119761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.120537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.121134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.286688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:36.295017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e829478b-b338-489c-875c-10c277885974 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.187828 Dec 16 17:56:36.295611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 108/210] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:36 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:36.568024 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:36.568685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:36.589101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.591248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.593312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.594436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.633877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:56:36.832704 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-77605bc3-bf90-4d62-97a3-fe5710c3fc00 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 204 len: 0 microversion: 2.1 time: 0.268743 Dec 16 17:56:36.833279 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 103/211] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:56:36 2021] DELETE /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:56:36.844197 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:36.844767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:36.853383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.853829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.854646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.855085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.939576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:36.941935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:36.951308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.952141 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:36.953140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:36.954160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:37.060571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-069ad267-50b5-44fd-b676-fc4a4300b587 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.127506 Dec 16 17:56:37.061428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 104/212] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:36 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:37.135284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:37.144594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-40e9e150-2e8b-4bab-ad98-8ea17aae4c03 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1553 microversion: 2.1 time: 0.306739 Dec 16 17:56:37.145627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 109/213] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:36 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:37.314907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:37.315557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:37.333870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:37.334296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:37.335945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:37.336543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:37.499046 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:37.508766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9965bab1-d234-4080-a907-330b6bf696de tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.199934 Dec 16 17:56:37.509338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 105/214] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:37 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:38.073158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:38.074115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:38.080931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.081618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.082399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.082862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.150592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d46568af-b862-46cb-bf40-4844231f8816 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.080864 Dec 16 17:56:38.152956 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 110/215] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:38 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 17:56:38.162515 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:38.164045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:38.173908 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.174411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.175577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.176183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.423888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:38.427684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-075a4424-1f6a-4515-aac1-98743b7e8549 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1553 microversion: 2.1 time: 0.269266 Dec 16 17:56:38.428571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 106/216] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:38 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:38.525681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:38.526521 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:38.534944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.535657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.536951 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:38.537842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:38.715712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:38.736025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6f90dfce-2504-492d-a5c5-768bf8462f87 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.214257 Dec 16 17:56:38.736755 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 111/217] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:38 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:39.164140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:39.165322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:39.172848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.173289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:39.174076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.174503 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:39.300357 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a0166361-7610-4233-b768-319866412dd9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.139649 Dec 16 17:56:39.301610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 107/218] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:39 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:39.451499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:39.452517 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:39.479231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.479566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:39.481043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.481629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:39.581974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1303309632", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:39.655547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] validate_networks() for None {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:56:39.732282 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:39.758528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c50906f0-01ed-4bb6-86a2-bc72640eabdf tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1553 microversion: 2.1 time: 0.312574 Dec 16 17:56:39.759134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 112/219] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:39 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:39.779378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:39.780067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:39.793364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.803479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:39.804442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:39.805699 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.090054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:56:40.091276 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:56:40.092609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:56:40.092609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:56:40.093022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:56:40.103506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.104589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.105987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.106754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.141841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Getting quotas for project 7c7e51ad8c174cd8b9cf54384ec5c6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:56:40.146233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Getting quotas for user 7a044e4cf07a4800872a58b12fa1e53a and project 7c7e51ad8c174cd8b9cf54384ec5c6d1. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:56:40.158512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:56:40.161154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:56:40.220234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ded4561a-cbd8-4ca2-a2b8-061a300200f2 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642524 Dec 16 17:56:40.220941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 108/220] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:56:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:56:40.241660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cafee1e5-3e0d-40ff-a3ce-7637e186bad9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:40.242315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cafee1e5-3e0d-40ff-a3ce-7637e186bad9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:40.329345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cafee1e5-3e0d-40ff-a3ce-7637e186bad9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:40.338438 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cafee1e5-3e0d-40ff-a3ce-7637e186bad9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1215 microversion: 2.1 time: 0.106277 Dec 16 17:56:40.339113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 109/221] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:40 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:40.345423 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:40.346384 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:40.362165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:40.364927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.365396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.367900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.368367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.371911 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-dedd13a3-4bf2-485c-ac58-ba9b67a640e6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.607678 Dec 16 17:56:40.372557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 113/222] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:39 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:40.739883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dd6c7eb0-2c9b-424a-879c-95f0f0055846 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.399375 Dec 16 17:56:40.741168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 110/223] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:40 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:40.777895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:40.779064 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:40.798117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.801264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.803493 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.805425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:40.948928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:40.954347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-8efba601-feb6-4461-a64b-d82b1cd140e3 req-a6c9a9d2-34cb-4a10-8914-9aeac9f3fbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdae2178-d068-4d45-806d-87fc881b37dd", "name": "network-vif-deleted", "tag": "6506aea0-64ec-479c-b87b-b1f8e1f05d52"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:40.956607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:40.956607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:56:40.960726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-25261412-10f4-4cbe-9aae-9d01f9d57a8b tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1511 microversion: 2.1 time: 0.188291 Dec 16 17:56:40.961697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 114/224] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:40 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:40.977519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8efba601-feb6-4461-a64b-d82b1cd140e3 req-a6c9a9d2-34cb-4a10-8914-9aeac9f3fbd3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:40.978083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8efba601-feb6-4461-a64b-d82b1cd140e3 req-a6c9a9d2-34cb-4a10-8914-9aeac9f3fbd3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.010056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-8efba601-feb6-4461-a64b-d82b1cd140e3 req-a6c9a9d2-34cb-4a10-8914-9aeac9f3fbd3 service nova] Creating event network-vif-deleted:6506aea0-64ec-479c-b87b-b1f8e1f05d52 for instance bdae2178-d068-4d45-806d-87fc881b37dd on hv-cinder-81920 Dec 16 17:56:41.016005 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-8efba601-feb6-4461-a64b-d82b1cd140e3 req-a6c9a9d2-34cb-4a10-8914-9aeac9f3fbd3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068511 Dec 16 17:56:41.017126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 111/225] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:41.362195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:41.362861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:41.369433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.369883 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.370662 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.371108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.390701 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:41.391705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:41.401076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.404837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.405872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.415388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.465820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:41.483508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fa640efc-01a9-4025-a112-64fbf5c194f6 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1211 microversion: 2.1 time: 0.130468 Dec 16 17:56:41.498813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 115/226] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:41 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:41.633350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:41.641789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cb1e5039-226b-4923-ac73-32237d922da3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.256269 Dec 16 17:56:41.642373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 112/227] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:41 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:41.751992 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:41.753239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:41.762080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.762535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.763578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.764367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.979009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:41.979635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:41.986828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.987267 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:41.988061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:41.988483 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:42.056698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:42.065132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9fdc8a1b-88d1-4cbf-ac57-90ca0e5cc2a3 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1345 microversion: 2.1 time: 0.090004 Dec 16 17:56:42.065675 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 113/228] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:41 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:42.500978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:42.501589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:42.508081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:42.508528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:42.509352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:42.509786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:42.575640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:42.583990 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-760bdae1-ec43-4ac4-81c3-90f678122e30 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1267 microversion: 2.1 time: 0.087080 Dec 16 17:56:42.584583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 114/229] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:42 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:42.658678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:42.659310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:42.665655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:42.666142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:42.667006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:42.667439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:42.996414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:43.005062 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7f0255a9-8b04-4220-9fb8-171ee3bcfd5d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.350013 Dec 16 17:56:43.005533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 115/230] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:42 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:43.081306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:43.081937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:43.088154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:43.088605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:43.089382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:43.089816 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:43.152731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:43.160715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bde76f9a-b998-4fd3-aa7b-0c9593f57537 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1345 microversion: 2.1 time: 0.083169 Dec 16 17:56:43.161270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 116/231] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:43 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:43.604967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:43.606006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:43.613135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:43.613585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:43.614378 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:43.614854 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:43.681399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:43.689014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f2187195-b564-41f2-bf8e-e04b946bc523 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1267 microversion: 2.1 time: 0.090328 Dec 16 17:56:43.689592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 117/232] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:43 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:44.023084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:44.023685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:44.030240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.030678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.031568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.031903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.166157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:44.174507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d3d21f50-bb9a-4073-945e-16e85c7d9049 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.155093 Dec 16 17:56:44.175153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 118/233] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:44 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:44.179559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:44.180155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:44.186545 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.187028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.187818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.188247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.193091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9f840d68-d13c-4add-8752-a153e415269e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 2.445372 Dec 16 17:56:44.194179 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 116/234] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:41 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:44.258051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:44.266154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a1127bac-c2cb-4e89-bb82-1e61bb65f80a tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1345 microversion: 2.1 time: 0.089931 Dec 16 17:56:44.266750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 119/235] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:44 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:44.711279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:44.712457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:44.721758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.722196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.723007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:44.723433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:44.798054 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:44.807995 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a7e7b03e-b846-4135-9cdf-14fcfdc5cc12 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1267 microversion: 2.1 time: 0.103591 Dec 16 17:56:44.808640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 117/236] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:44 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:45.191698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:45.192329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:45.201176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.201790 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.202596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.203064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.204122 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:45.205540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:45.220108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.220108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.220108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.220108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.348794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:45.359550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5c7cfe54-5d61-40e5-b307-8f1ad844b029 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.171793 Dec 16 17:56:45.360133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 120/237] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:45 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:45.364634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:45.365237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:45.371365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.371782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.372700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.373137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.437624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:45.449508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e1c297f4-af5d-4314-afd6-457996dd11cc tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1345 microversion: 2.1 time: 0.088161 Dec 16 17:56:45.450342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 121/238] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:45 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:45.807997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9cd518d7-f1fc-4525-8166-89a1b6634341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.608102 Dec 16 17:56:45.808660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 118/239] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:45 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:45.827962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:45.828542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:45.835372 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.835842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.836623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:45.837367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:45.907748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:45.917369 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-465fea24-cbe0-4fbe-88ee-38f84227f976 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1267 microversion: 2.1 time: 0.093667 Dec 16 17:56:45.918147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 122/240] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:45 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:46.378041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:46.379378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:46.387447 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.388242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.389546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.390280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.467967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:46.468578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:46.481553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.482330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.484354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.485106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.568756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71fe44f025c4454ae3756ae55a67f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1670f03a08914a50ac3c502be6456794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:46.578024 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f282be56-74a0-428f-a9d7-de73dfe6c931 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 200 len: 1345 microversion: 2.1 time: 0.114751 Dec 16 17:56:46.578803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 123/241] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:46 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 1345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:46.673110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:46.689638 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c8b2ba8e-4a24-4753-8de7-a7e575076a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.316461 Dec 16 17:56:46.690530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 119/242] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:46 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:46.819603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:46.820585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:46.833427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.833877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.834695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.835131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.911079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-521ad1e4-4c6b-41d9-a99c-0fff9d915b21 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 14 microversion: 2.1 time: 0.094862 Dec 16 17:56:46.911929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 124/243] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:46 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:46.934441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:46.935154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:46.948309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.949092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:46.949910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:46.950754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:47.256809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:47.270578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b11265ba-be8a-430d-aefa-2be3b00c8aba tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.338928 Dec 16 17:56:47.272342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 120/244] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:46 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:47.515616 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2073229353", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "eec24439-f2c6-4e67-81a7-96a21069ee65"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:47.595029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:47.595939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:47.610703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:47.611122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] validate_networks() for [('eec24439-f2c6-4e67-81a7-96a21069ee65', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:56:47.613191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:47.614578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:47.615194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:47.657393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] HTTP exception thrown: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. Dec 16 17:56:47.661587 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Returning 404 to user: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:56:47.665625 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-245ed0c1-9982-4b0d-bbdc-379be0357488 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 404 len: 111 microversion: 2.1 time: 0.074262 Dec 16 17:56:47.670811 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 121/245] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:47 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 17:56:47.707383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:47.708137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:47.716172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:47.719201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:47.721007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:47.722459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:47.990895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:48.005913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6caa405c-aec6-448e-b21d-88b2d4e05ddc tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.302811 Dec 16 17:56:48.007898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 122/246] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:47 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:48.016255 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:48.017781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:48.024778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.025579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.027130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.028448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.048143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] HTTP exception thrown: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. Dec 16 17:56:48.048969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Returning 404 to user: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:56:48.049916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-438c3e4b-bc07-4278-8a90-22fa3a0251e4 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040072 Dec 16 17:56:48.050930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 123/247] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:56:48 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:56:48.057697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1884647385", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d5430d91-7e76-4358-9d35-08edfd4e96f5"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:48.131023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] validate_networks() for [('d5430d91-7e76-4358-9d35-08edfd4e96f5', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:56:48.264058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:56:48.264580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:56:48.265841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:56:48.266658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:56:48.267269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:56:48.287656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.288257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.289267 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.289834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.307498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Getting quotas for project 9fd9aefb930a48bfaa54182fe6a4a20c. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:56:48.313433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Getting quotas for user 75f33f9ecdbf4e6ea3581cea3ab2ca16 and project 9fd9aefb930a48bfaa54182fe6a4a20c. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:56:48.324547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:56:48.327508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:56:48.376070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-554b8845-6fa5-4e0a-8911-338e9e509cfd tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864963 Dec 16 17:56:48.381598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 125/248] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:56:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:56:48.381598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:48.382810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:48.389746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.390170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.390984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.391432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.475583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5dde5acd-ad60-4cd6-a1b4-95d18d08af33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 1894 microversion: 2.1 time: 0.096770 Dec 16 17:56:48.481675 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 126/249] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:48 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 1894 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:48.502360 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-867309af-87ed-45aa-9863-0ace9184d7a4 req-57e19743-eae1-424c-b385-7344b01eab61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0480b790-1334-4c35-b106-1bdb9a3a6222", "tag": "571e0640-c501-42de-b958-31fede094247"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:48.504434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:48.504434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:56:48.515236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-867309af-87ed-45aa-9863-0ace9184d7a4 req-57e19743-eae1-424c-b385-7344b01eab61 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.516084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-867309af-87ed-45aa-9863-0ace9184d7a4 req-57e19743-eae1-424c-b385-7344b01eab61 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.549198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-867309af-87ed-45aa-9863-0ace9184d7a4 req-57e19743-eae1-424c-b385-7344b01eab61 service nova] Creating event network-changed:571e0640-c501-42de-b958-31fede094247 for instance 0480b790-1334-4c35-b106-1bdb9a3a6222 on hv-cinder-81920 Dec 16 17:56:48.556307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-867309af-87ed-45aa-9863-0ace9184d7a4 req-57e19743-eae1-424c-b385-7344b01eab61 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072201 Dec 16 17:56:48.557301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 127/250] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:48.564262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:48.565370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:48.573885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.574506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.575462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.576323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.919730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:48.931193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e7e8bf9b-184c-452e-8ec0-8e309f002b89 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.372145 Dec 16 17:56:48.932189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 128/251] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:48 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:48.948098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:48.949514 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:48.957190 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:56:48.957767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:56:48.958244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:56:48.958743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:56:48.959155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:56:48.959433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.959876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.960657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.961078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.969809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.970475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.971485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:48.972203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:48.995984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:56:49.002163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for user e85da5cbc170449cb9f74d845845bc35 and project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:56:49.016601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:56:49.018977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:56:49.027139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:49.035520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8ce8110a-4ed3-48eb-93f1-1edeaef111df tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1218 microversion: 2.1 time: 0.102063 Dec 16 17:56:49.036109 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 129/252] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:48 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:49.046112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:49.046859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.054234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.055097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.056022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.056509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.072940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c5f55743-dab7-40c9-bc66-4d1b10b5b25f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020010 Dec 16 17:56:49.078803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 124/253] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:56:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:56:49.089160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-225917ad-f8cf-41e6-802e-ffffacf25b09 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:49.090074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-225917ad-f8cf-41e6-802e-ffffacf25b09 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.146351 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-225917ad-f8cf-41e6-802e-ffffacf25b09 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:49.154223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-225917ad-f8cf-41e6-802e-ffffacf25b09 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1218 microversion: 2.1 time: 0.072000 Dec 16 17:56:49.155081 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 125/254] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:49 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:49.329730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:49.330562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.339476 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:49.345320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.345766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.346593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.347125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.353257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0b7383dd-1e42-4b00-88c9-b98259c68dc2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1523 microversion: 2.1 time: 0.312750 Dec 16 17:56:49.362606 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 130/255] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:49 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:49.368637 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] HTTP exception thrown: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. Dec 16 17:56:49.369226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Returning 404 to user: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:56:49.370065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aa5718c3-c523-4b09-8259-9d4d6c4ee5b5 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 404 len: 111 microversion: 2.1 time: 0.045834 Dec 16 17:56:49.372474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 126/256] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:56:49 2021] DELETE /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:56:49.379348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:49.380249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] [instance: bdae2178-d068-4d45-806d-87fc881b37dd] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.388644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.389123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.390439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.390439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.406359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] HTTP exception thrown: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. Dec 16 17:56:49.406987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] Returning 404 to user: Instance bdae2178-d068-4d45-806d-87fc881b37dd could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:56:49.407812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cf36aa13-307e-49ae-823b-1605d545f512 tempest-DeleteServersTestJSON-1537369593 tempest-DeleteServersTestJSON-1537369593-project] 10.222.0.32 "GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd" status: 404 len: 111 microversion: 2.1 time: 0.032219 Dec 16 17:56:49.408373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 131/257] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:49 2021] GET /compute/v2.1/servers/bdae2178-d068-4d45-806d-87fc881b37dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 17:56:49.489096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:49.491433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.498328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.499003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.500031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.500793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.716155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-28c5630b-9b1c-479d-a524-ffa80dee6f14 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 9709 microversion: 2.1 time: 0.230544 Dec 16 17:56:49.716847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 127/258] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:49 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 9709 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:49.949451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:49.950306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:49.962559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.963033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:49.963827 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:49.966611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.055604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:50.056311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:50.065082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.066831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.067833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.068479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.171593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:50.179491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-587c3837-17ac-426c-92de-bcd0b51f3dcf tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1272 microversion: 2.1 time: 0.129299 Dec 16 17:56:50.180064 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 128/259] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:50 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1272 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:50.189014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:50.190905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:50.202586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.203057 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.204546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.204546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.331762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:50.339647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f88e0eb8-4668-4114-9957-f5648b469d16 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1270 microversion: 2.1 time: 0.155330 Dec 16 17:56:50.343323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 129/260] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:50 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:50.370490 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:50.370873 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:50.371728 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:50.382169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-730ea244-9e75-4141-80f6-9446e7f96f4d tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.436335 Dec 16 17:56:50.382702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.392583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 132/261] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:49 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:50.393971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.395031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.395474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.595506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:50.603300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9929ea1b-f0ff-4d87-a6e3-7fbf07434451 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1503 microversion: 2.1 time: 0.236636 Dec 16 17:56:50.604278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 130/262] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:50 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:50.620608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:50.621645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:50.630822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.632036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.634983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.635813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.729940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:50.731162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:50.743007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.747129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.748163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:50.749935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:50.889392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8ae7495d-fc97-47ce-9a9c-9c4faec1c177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 15025 microversion: 2.1 time: 0.163658 Dec 16 17:56:50.889392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 131/263] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:50 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 15025 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:51.007607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:51.027024 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2a49f492-f5fd-4b01-9395-289af96c68d8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1516 microversion: 2.1 time: 0.410205 Dec 16 17:56:51.030164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 133/264] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:50 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1516 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:51.198527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:51.199283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:51.211365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.211854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.213752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.215365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.357794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:51.358415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:51.366118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.371314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.372540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.372998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.533763 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:51.550933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e62db5b0-43a2-4a50-8566-2d30822d1287 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1276 microversion: 2.1 time: 0.194538 Dec 16 17:56:51.553473 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 134/265] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:51 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:51.564941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:51.571171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:51.585968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.590188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.591717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.593538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.812747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:51.829098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7427d83d-3492-4fa7-a36c-95aa465cebc3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.634972 Dec 16 17:56:51.829819 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 132/266] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:51 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:51.894927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:51.910788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:51.912130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:51.916370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bfba2415-07c1-41f1-86a2-584ad73cc050 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.361160 Dec 16 17:56:51.918157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 135/267] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:51 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:51.932073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.932791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:51.933608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:51.934181 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.070123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9044e87b-9dd0-45d6-814b-f3adbeb21b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 18276 microversion: 2.1 time: 0.172238 Dec 16 17:56:52.071159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 133/268] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:51 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 18276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:52.543921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-5f57b2a3-ac97-4a5d-ac10-85a776fa2661 req-7b1b66c4-de6c-4617-bf65-599d61f3ddd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195428b1-4838-4e80-b993-64ac7519a142", "tag": "20a11076-ef2c-48a2-aec6-2353860b0954"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:52.545671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:52.545671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:56:52.564222 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-5f57b2a3-ac97-4a5d-ac10-85a776fa2661 req-7b1b66c4-de6c-4617-bf65-599d61f3ddd7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.566895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-5f57b2a3-ac97-4a5d-ac10-85a776fa2661 req-7b1b66c4-de6c-4617-bf65-599d61f3ddd7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.569058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:52.569762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:52.588367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.590199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.593111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.598709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.599909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-5f57b2a3-ac97-4a5d-ac10-85a776fa2661 req-7b1b66c4-de6c-4617-bf65-599d61f3ddd7 service nova] Creating event network-changed:20a11076-ef2c-48a2-aec6-2353860b0954 for instance 195428b1-4838-4e80-b993-64ac7519a142 on hv-cinder-81920 Dec 16 17:56:52.608571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-5f57b2a3-ac97-4a5d-ac10-85a776fa2661 req-7b1b66c4-de6c-4617-bf65-599d61f3ddd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068455 Dec 16 17:56:52.614598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 136/269] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:52.691018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:52.692053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:52.706236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.706862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.707673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.708099 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.742604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lazy-loading 'flavor' on Instance uuid 71b128b8-90f3-4162-82d5-7b55358c2a7f {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:56:52.894049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c0f6634c-2aa2-42a6-88b6-8193d56195f0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action" status: 200 len: 32 microversion: 2.1 time: 0.207024 Dec 16 17:56:52.894679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 137/270] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:52 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:56:52.912310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:52.918063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:52.937886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.939149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:52.942279 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:52.943733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.007026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:53.022252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8a3047b6-d974-489a-a62f-1255a37dbddd tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.457752 Dec 16 17:56:53.032747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 134/271] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:52 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:53.038310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:53.039569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:53.049695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.052627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.054174 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.055528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.365372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:53.382771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-16219a6e-f61a-4978-a10e-d0f92e12ff10 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.346615 Dec 16 17:56:53.384844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 135/272] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:53 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:53.406253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:53.407021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:53.426270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.426762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.427593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.428029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.643914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:53.651922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-af67e410-3baa-4338-9674-c8e7c0a09b2c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.754769 Dec 16 17:56:53.655446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 138/273] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:52 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:53.666146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:53.667907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:53.678454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.683921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.685167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.688288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.733408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:53.748252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cc94f3c0-9a5c-4252-ad86-ed04c0da6770 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.348215 Dec 16 17:56:53.751620 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 136/274] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:53 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:53.759310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-a4b05045-0e00-4add-9684-5ddd7292fde2 req-b6833dba-b2fc-4e79-8228-6cc99a11247b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e", "tag": "48b73dbf-c1ab-40c9-b3f0-e69075e73c6e"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:53.764315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:53.764315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:56:53.782072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-a4b05045-0e00-4add-9684-5ddd7292fde2 req-b6833dba-b2fc-4e79-8228-6cc99a11247b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:53.782833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-a4b05045-0e00-4add-9684-5ddd7292fde2 req-b6833dba-b2fc-4e79-8228-6cc99a11247b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:53.796938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-a4b05045-0e00-4add-9684-5ddd7292fde2 req-b6833dba-b2fc-4e79-8228-6cc99a11247b service nova] Creating event network-changed:48b73dbf-c1ab-40c9-b3f0-e69075e73c6e for instance 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e on hv-cinder-81920 Dec 16 17:56:53.801859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-a4b05045-0e00-4add-9684-5ddd7292fde2 req-b6833dba-b2fc-4e79-8228-6cc99a11247b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048861 Dec 16 17:56:53.802708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 137/275] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:54.042423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:54.043177 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:54.053722 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.055267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.058371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.060644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.107198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-103f0bbb-12c0-4e22-8f86-3a27df289201 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 21457 microversion: 2.1 time: 0.447815 Dec 16 17:56:54.109413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 139/276] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:53 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 21457 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:54.405115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:54.406082 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:54.413881 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.414756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.415745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.416377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.476758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:54.497534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2344a9b6-8edd-480a-95dc-0da71d436e2c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.456568 Dec 16 17:56:54.507957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 138/277] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:54 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:54.673610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:54.675578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:54.692859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.695551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.698528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.700569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.926882 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:54.941136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ff5a6e4e-3e19-4231-8ef7-ed5ab5003872 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.538994 Dec 16 17:56:54.942131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 140/278] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:54 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:54.956850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:54.961942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:54.973918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.974788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:54.975864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:54.976633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.295338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:55.328060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-72ed6d72-1840-437d-829a-616ee6f85bf9 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.383845 Dec 16 17:56:55.337379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 141/279] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:54 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:55.353229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:55.356743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:55.365750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.366534 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.368048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.368578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.576179 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f633742f-86ab-49e0-8cb3-8ad26a785640 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 23229 microversion: 2.1 time: 0.236615 Dec 16 17:56:55.577523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 142/280] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:55 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 23229 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:55.584064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:55.585105 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:55.593927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.594998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.596624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.597427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.657965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:55.667187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8930093f-3736-4e6e-b85f-3598998dd26b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.999018 Dec 16 17:56:55.667720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 139/281] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:54 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:55.959960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:55.960743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:55.972473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.979716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.981618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:55.982509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:55.996889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:56.009068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-28464ba9-eb4f-41cf-bbaf-d398b96dc2da tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.429913 Dec 16 17:56:56.017805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 143/282] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:55 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:56.215612 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:56.232473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-06b47531-69be-4cd8-83d9-60912b83c2e5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.275323 Dec 16 17:56:56.235865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 140/283] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:55 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:56.346817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:56.348153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:56.363349 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.365507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.370221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.372947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.589032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:56.590585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:56.605532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.606409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.608727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.610266 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.712316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-832e347b-c3e6-40bf-9ce7-297822eaa799 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 24540 microversion: 2.1 time: 0.126917 Dec 16 17:56:56.718910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 141/284] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:56 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 24540 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:56.726074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:56.727245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:56.739322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.740450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.741763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.742404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.858949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:56.880516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6bbd2859-a5d2-4536-80b4-da1915703217 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.538499 Dec 16 17:56:56.883519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 144/285] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:56 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:56.890152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-13837c74-7df0-4a9a-9e86-edd585836b90 req-c36325ee-a649-42fc-9165-f620833e2a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0480b790-1334-4c35-b106-1bdb9a3a6222", "name": "network-vif-plugged", "status": "completed", "tag": "571e0640-c501-42de-b958-31fede094247"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:56.894604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:56:56.894604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:56:56.911173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-13837c74-7df0-4a9a-9e86-edd585836b90 req-c36325ee-a649-42fc-9165-f620833e2a0f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:56.913750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-13837c74-7df0-4a9a-9e86-edd585836b90 req-c36325ee-a649-42fc-9165-f620833e2a0f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:56.929277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-13837c74-7df0-4a9a-9e86-edd585836b90 req-c36325ee-a649-42fc-9165-f620833e2a0f service nova] Creating event network-vif-plugged:571e0640-c501-42de-b958-31fede094247 for instance 0480b790-1334-4c35-b106-1bdb9a3a6222 on hv-cinder-81920 Dec 16 17:56:56.937644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-13837c74-7df0-4a9a-9e86-edd585836b90 req-c36325ee-a649-42fc-9165-f620833e2a0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052601 Dec 16 17:56:56.940255 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 145/286] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:56:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:56:57.032320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:57.034289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:57.049050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.049773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.050754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.051411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.070453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:57.084011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9dde1b49-1913-4716-9e9f-38d4a1f06d09 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.363400 Dec 16 17:56:57.086909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 142/287] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:56 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:57.251986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:57.252738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:57.265502 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.266111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.273820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.274304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.582893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:57.593309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-44ad55e7-fe69-43de-8c9a-643b3f3019f7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.345187 Dec 16 17:56:57.603143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 143/288] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:57 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:57.637405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:57.647114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fbc26d3a-35e6-4992-a90b-2475ec7b8ae3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.623970 Dec 16 17:56:57.648502 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 146/289] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:57 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:57.732034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:57.734441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:57.745706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.746735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.747928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.748568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.848096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f6a7dbf3-da02-4f21-b8e8-83f15ed4d616 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 25845 microversion: 2.1 time: 0.124133 Dec 16 17:56:57.849010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 144/290] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:57 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 25845 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:57.902984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:57.904853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:57.916549 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.917296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:57.919935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:57.920971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.112250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:58.113216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:58.127353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.127800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.128734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.129195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.420863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:58.447213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8984601c-34db-43c5-9d9d-68e089f0367e tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.333709 Dec 16 17:56:58.461621 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 145/291] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:58 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:58.461875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:58.477322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6259b87b-6734-4165-87ac-44f77d86c338 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1315 microversion: 2.1 time: 0.581074 Dec 16 17:56:58.484365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 147/292] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:57 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:58.611951 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:58.613318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:58.620617 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.621303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.623791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.624071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.665160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:58.666134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:58.689298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.691181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.692296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.696100 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.841330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:58.852690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a5ecdb03-4db5-48cc-be4a-eaeff7af69d6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.245691 Dec 16 17:56:58.855857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 146/293] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:58 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:58.862467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:56:58.864001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:58.872362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.872907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:58.873760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:58.874351 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.013012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ef3e31fd-4f9f-4a56-a2d3-b4dcc14a85a5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 26687 microversion: 2.1 time: 0.155045 Dec 16 17:56:59.019053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 147/294] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:56:58 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 26687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:56:59.253781 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:59.261959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f52af78d-e0b6-430c-bb8e-88546dd10d79 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.600837 Dec 16 17:56:59.270294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 148/295] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:58 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:56:59.470600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:59.474449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:59.489365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.489830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.494152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.499985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.503894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:59.504542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:59.515364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.516963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.517798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.518228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.836278 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:59.847083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-622f84aa-e7e1-4051-bc8a-ccc9ce99ebca tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1464 microversion: 2.1 time: 0.348190 Dec 16 17:56:59.847686 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 149/296] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:59 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:59.871858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:59.872552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:59.880825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:56:59.882075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.882535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.883364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.883795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.890654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7f1a8255-d16b-4fb3-a73b-4dc8b81dc733 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.424511 Dec 16 17:56:59.900900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 148/297] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:59 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:56:59.906127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:56:59.906887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:56:59.913798 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.914763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.915782 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:56:59.916443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:56:59.943310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:57:00.123505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f3b2317b-d006-4b9a-8113-1ab959327c83 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 204 len: 0 microversion: 2.1 time: 0.220533 Dec 16 17:57:00.128420 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 149/298] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:56:59 2021] DELETE /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:57:00.141348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:00.146007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:00.171462 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.172565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.173800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.174591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.200754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:00.210031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-42365ee1-afd1-432f-9a7b-473dceaff246 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.341676 Dec 16 17:57:00.228315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 150/299] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:56:59 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:00.239406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:00.240211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:00.255085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.255628 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.256497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.256996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.297152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-44bf2df8-07a0-4d61-b448-6b4c41c9be05 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 27516 microversion: 2.1 time: 0.166648 Dec 16 17:57:00.299306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 150/300] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:00 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 27516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:00.310272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:00.311652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:00.324582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.325354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.326336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.326978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.529179 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:00.540668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ed9a8521-71ec-4070-97c8-afa598cc1795 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1470 microversion: 2.1 time: 0.311106 Dec 16 17:57:00.541711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 151/301] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:00 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:00.708234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-358b0046-5db9-4d86-9c37-ec760fc7d3e1 req-6ab6c8c3-46a7-4a5b-80a7-351c35906745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195428b1-4838-4e80-b993-64ac7519a142", "name": "network-vif-plugged", "status": "completed", "tag": "20a11076-ef2c-48a2-aec6-2353860b0954"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:00.710168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:00.710168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:00.727929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-358b0046-5db9-4d86-9c37-ec760fc7d3e1 req-6ab6c8c3-46a7-4a5b-80a7-351c35906745 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.728626 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-358b0046-5db9-4d86-9c37-ec760fc7d3e1 req-6ab6c8c3-46a7-4a5b-80a7-351c35906745 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.758733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-358b0046-5db9-4d86-9c37-ec760fc7d3e1 req-6ab6c8c3-46a7-4a5b-80a7-351c35906745 service nova] Creating event network-vif-plugged:20a11076-ef2c-48a2-aec6-2353860b0954 for instance 195428b1-4838-4e80-b993-64ac7519a142 on hv-cinder-81920 Dec 16 17:57:00.770934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-358b0046-5db9-4d86-9c37-ec760fc7d3e1 req-6ab6c8c3-46a7-4a5b-80a7-351c35906745 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066224 Dec 16 17:57:00.773391 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 152/302] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:57:00.909914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:00.910655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:00.926106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.926562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:00.927402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:00.927836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.064147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:01.074782 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4763f3b0-3e5b-4244-92df-1e1c89b01ac3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.773372 Dec 16 17:57:01.087002 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 151/303] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:00 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:01.230928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:01.232449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:01.246244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.246721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.247838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.248741 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.331122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:01.340269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-48a50749-2e7e-46dd-b42b-a021313e6b9f tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.435391 Dec 16 17:57:01.344745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 153/304] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:00 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:01.352270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:01.354091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:01.368412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.369565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.370757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.372347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.537857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:01.548427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aa32f428-7cd4-4cdf-8924-f9863f974f26 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.322686 Dec 16 17:57:01.549001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 152/305] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:01 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:01.566687 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:01.567495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:01.574914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.575448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.576248 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:01.577042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:01.711096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d6c46a2b-391b-420d-8d9e-9cd5dac9a9e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 27855 microversion: 2.1 time: 0.364586 Dec 16 17:57:01.712165 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 154/306] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:01 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 27855 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:01.868710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:01.881347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9a5adb47-d6cc-4932-ac0e-3333d18d525c tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1470 microversion: 2.1 time: 0.319050 Dec 16 17:57:01.902122 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 153/307] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:01 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:02.111131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:02.113895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:02.182145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:02.200974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:02.204306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:02.204820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:02.361158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:02.361797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:02.374264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:02.375133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:02.377742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:02.379456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.123282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:03.148509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0aa3a45f-8be6-4fb2-9ace-e714a5c76b5c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 1.038736 Dec 16 17:57:03.149217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 155/308] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:02 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:03.177282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:03.180320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:03.197171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.199034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.204161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.205049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.224629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:03.237095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7a578ea4-b6db-44d5-929c-231266a3c49c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1314 microversion: 2.1 time: 0.879599 Dec 16 17:57:03.239438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 154/309] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:02 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:03.247620 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:03.249085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:03.259397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.261402 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.262701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.263435 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.405206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-134d27a4-62d1-468c-b8f1-e8522306b518 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.163252 Dec 16 17:57:03.405894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 155/310] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:03 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:03.415132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:03.418568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:03.437513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.444411 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.445480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.445937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.573232 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:03.585174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-91622ce4-cb80-445b-8997-a1c9ac7d5520 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.423721 Dec 16 17:57:03.590363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 156/311] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:03 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:03.612874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-751ddda4-dacf-4b9b-9fa1-c5f2d531b611 req-dae2e594-1ffc-486e-9c27-e143c0fd12f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e", "name": "network-vif-plugged", "status": "completed", "tag": "48b73dbf-c1ab-40c9-b3f0-e69075e73c6e"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:03.617943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:03.617943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:03.643652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-751ddda4-dacf-4b9b-9fa1-c5f2d531b611 req-dae2e594-1ffc-486e-9c27-e143c0fd12f8 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:03.644469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-751ddda4-dacf-4b9b-9fa1-c5f2d531b611 req-dae2e594-1ffc-486e-9c27-e143c0fd12f8 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:03.705820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-751ddda4-dacf-4b9b-9fa1-c5f2d531b611 req-dae2e594-1ffc-486e-9c27-e143c0fd12f8 service nova] Creating event network-vif-plugged:48b73dbf-c1ab-40c9-b3f0-e69075e73c6e for instance 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e on hv-cinder-81920 Dec 16 17:57:03.721558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-751ddda4-dacf-4b9b-9fa1-c5f2d531b611 req-dae2e594-1ffc-486e-9c27-e143c0fd12f8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127988 Dec 16 17:57:03.724143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 157/312] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:03.913419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:03.933230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3b9ff06a-dfb3-43f4-a453-b75b4911cf46 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1470 microversion: 2.1 time: 0.525801 Dec 16 17:57:03.934393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 156/313] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:03 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:04.077335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-01551ebb-1bfc-41cd-beb8-1d4094b29d1f req-b7309ed7-72f3-42ae-8809-33b65d230a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0480b790-1334-4c35-b106-1bdb9a3a6222", "name": "network-vif-deleted", "tag": "571e0640-c501-42de-b958-31fede094247"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:04.079237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:04.079237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:04.119303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-01551ebb-1bfc-41cd-beb8-1d4094b29d1f req-b7309ed7-72f3-42ae-8809-33b65d230a9c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.121055 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-01551ebb-1bfc-41cd-beb8-1d4094b29d1f req-b7309ed7-72f3-42ae-8809-33b65d230a9c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.160110 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-01551ebb-1bfc-41cd-beb8-1d4094b29d1f req-b7309ed7-72f3-42ae-8809-33b65d230a9c service nova] Creating event network-vif-deleted:571e0640-c501-42de-b958-31fede094247 for instance 0480b790-1334-4c35-b106-1bdb9a3a6222 on hv-cinder-81920 Dec 16 17:57:04.166536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:04.167203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:04.173351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-01551ebb-1bfc-41cd-beb8-1d4094b29d1f req-b7309ed7-72f3-42ae-8809-33b65d230a9c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099895 Dec 16 17:57:04.179272 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 158/314] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:04.186772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.187239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.192392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.192843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.269489 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:04.274698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:04.319237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.320059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.323943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.324737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.713077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:04.726940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e43ac576-d82f-4655-94b7-55f6458cf22e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.562155 Dec 16 17:57:04.729607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 157/315] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:04 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:04.743237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:04.744448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:04.764040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.765616 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.767621 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.770194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.873253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:04.881215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2f2dc558-3cfe-4cfb-8242-1d3d5391ef58 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1499 microversion: 2.1 time: 0.629200 Dec 16 17:57:04.886685 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d473e711-0b72-4c07-a627-c586a99ae608 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.155468 Dec 16 17:57:04.887709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 158/316] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:04 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:04.897409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:04.897646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 159/317] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:04 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1499 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:04.898767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:04.928392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.936234 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.938632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.943535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.952030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:04.952790 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:04.975620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.987119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:04.988201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:04.990774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.070652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:05.079845 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.080786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lazy-loading 'fault' on Instance uuid 0480b790-1334-4c35-b106-1bdb9a3a6222 {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:57:05.218348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a044e4cf07a4800872a58b12fa1e53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7e51ad8c174cd8b9cf54384ec5c6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:05.231931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4ee05348-e894-4751-8e5d-54c6b41fbea7 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 200 len: 1305 microversion: 2.1 time: 0.284363 Dec 16 17:57:05.235123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 160/318] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:04 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:05.492359 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:05.504956 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a585d8ac-89e9-47ab-9a86-8d8899b3c196 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.615585 Dec 16 17:57:05.517059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 159/319] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:04 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:05.579875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:05.580582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:05.588435 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:05.589330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.590253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:05.591530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.627826 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:57:05.807197 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b41b7b8d-b883-46c4-a5f9-10fc1a7af8e3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "DELETE /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 204 len: 0 microversion: 2.1 time: 0.231972 Dec 16 17:57:05.809457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 160/320] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:57:05 2021] DELETE /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:57:05.821748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:05.822718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:05.832090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:05.833015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.834017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:05.834465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:05.850142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: .version_select at 0x7fca1c1ff8b0>, body: {"keypair": {"name": "tempest-keypair-1873861498"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:05.939672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:05.945581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:06.239337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:06.250181 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-91f4c2f1-21dc-4bd9-b00e-5a618b529de7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1318 microversion: 2.1 time: 0.432900 Dec 16 17:57:06.252220 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 161/321] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:05 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:06.267111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:06.268701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:06.287188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:06.289098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:06.290730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:06.293410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:06.839829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:06.850410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-92137247-c46e-4d4c-b1e9-00f157d3d2c8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1505 microversion: 2.1 time: 0.594295 Dec 16 17:57:06.866760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 162/322] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:06 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:06.886850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:06.889681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:06.911042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:06.912436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:06.917751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:06.921167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.028711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-25401bdd-b687-4a81-aabc-60ab647f6d19 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.160101 Dec 16 17:57:07.030247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 163/323] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:06 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:07.041636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:07.042354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] [instance: 0480b790-1334-4c35-b106-1bdb9a3a6222] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:07.063765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.064387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.065216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.065660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.111102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] HTTP exception thrown: Instance 0480b790-1334-4c35-b106-1bdb9a3a6222 could not be found. Dec 16 17:57:07.111978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] Returning 404 to user: Instance 0480b790-1334-4c35-b106-1bdb9a3a6222 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:57:07.114362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ef120fa9-0cc7-4e1d-8895-d7583628b379 tempest-VolumesNegativeTest-1923471160 tempest-VolumesNegativeTest-1923471160-project] 10.222.0.32 "GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222" status: 404 len: 111 microversion: 2.1 time: 0.082467 Dec 16 17:57:07.115335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 164/324] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:07 2021] GET /compute/v2.1/servers/0480b790-1334-4c35-b106-1bdb9a3a6222 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:57:07.142486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:07.144646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:07.161842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.162571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.164085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.165362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.269227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:07.274861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:07.297210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-698a11da-2f3a-484f-9e6c-d3c27c63327e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.000134 Dec 16 17:57:07.306422 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 161/325] 10.222.0.32 () {62 vars in 1198 bytes} [Thu Dec 16 17:57:05 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2010 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 17:57:07.312918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:07.314362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:07.325347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.326592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.328711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.329329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.603821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:07.625948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a7e7da94-ef41-4ea7-b65e-e70f306cfc4c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.508655 Dec 16 17:57:07.627631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 165/326] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:07 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:07.730071 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:07.742121 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-37d04911-bb50-4d09-b77c-f657dcb7f643 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1507 microversion: 2.1 time: 0.430862 Dec 16 17:57:07.742676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 162/327] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:07 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:07.761469 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d756caf-3996-4cdb-b08b-b87c0b4939c4"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:07.763292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:07.784456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.784919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.788022 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.788629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.873899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:07.874809 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:07.886073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.889174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:07.890206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:07.891817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.016148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Invalid volume: volume 5d756caf-3996-4cdb-b08b-b87c0b4939c4 is already attached to instances: 0661c266-f8da-443a-81eb-4f6b894dd906 Dec 16 17:57:08.016766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 400 to user: Invalid volume: volume 5d756caf-3996-4cdb-b08b-b87c0b4939c4 is already attached to instances: 0661c266-f8da-443a-81eb-4f6b894dd906 {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:57:08.017614 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1c5e4d23-e74f-4be8-9a20-15fa5f0609d1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.262093 Dec 16 17:57:08.050780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 166/328] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:57:07 2021] POST /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 17:57:08.068011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:08.069434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:08.147581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.149997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.153619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.156567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.295765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6945373d-34c2-46be-98b7-8a5974a39e0d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.242397 Dec 16 17:57:08.298787 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 167/329] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:08 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:08.318227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:08.321943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:08.339524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.341538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.343422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.347503 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.475599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:08.487403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bd160c19-67c7-49dc-a924-aefc74df57a8 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1505 microversion: 2.1 time: 0.617541 Dec 16 17:57:08.509696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 163/330] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:07 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:08.656321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:08.665281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:08.698346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.702376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.704012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:08.705698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:08.813886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'services' on Instance uuid 0661c266-f8da-443a-81eb-4f6b894dd906 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:57:09.177774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fe1415d6-6e56-4bc5-a150-6f1ea724d9bb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments/5d756caf-3996-4cdb-b08b-b87c0b4939c4" status: 202 len: 0 microversion: 2.1 time: 0.874121 Dec 16 17:57:09.178604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 168/331] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:57:08 2021] DELETE /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments/5d756caf-3996-4cdb-b08b-b87c0b4939c4 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:57:09.194442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:09.195679 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:09.224646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.225338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.228677 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.229251 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.353572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cdd9c485-12e1-4c8a-9c00-e122b382889b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169877 Dec 16 17:57:09.366304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 169/332] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:57:09 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:09.384224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:09.386866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:09.410751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.415609 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.420690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.421216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.456654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:09.466575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e8cde273-809f-460c-ba51-25762547d53d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.825010 Dec 16 17:57:09.468426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 164/333] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:08 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:09.505310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:09.506726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:09.521035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.523139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.526816 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:09.527545 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:09.569250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-00ec8615-7fbe-462d-9872-a4484237de85 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.200157 Dec 16 17:57:09.574050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 170/334] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:09 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:10.199339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:10.210856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a2642a41-8305-4e2a-b21c-d8a23193bd11 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1505 microversion: 2.1 time: 0.709196 Dec 16 17:57:10.215072 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 165/335] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:09 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1505 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:10.389023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:10.389657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:10.407861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.411714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.414709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.417015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.492703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:10.493392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:10.502017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.503012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.504480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.505286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.521260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-01426b02-8b6b-41cd-b00d-f4eb7c594dbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146312 Dec 16 17:57:10.526848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 171/336] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:57:10 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:57:10.600350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:10.613295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:10.624818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.625583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.626648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:10.627258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:10.706235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-142c486b-87ce-4a19-a262-0497db66233a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.120382 Dec 16 17:57:10.707472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 172/337] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:10 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:10.767260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-467994107", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d5430d91-7e76-4358-9d35-08edfd4e96f5"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:11.115691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] validate_networks() for [('d5430d91-7e76-4358-9d35-08edfd4e96f5', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:57:11.348857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:11.375681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bcf1f1cc-accd-495e-aa8b-d54ced695e63 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1502 microversion: 2.1 time: 0.889753 Dec 16 17:57:11.391775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 166/338] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:10 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1502 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:11.411302 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-d92d420d-3672-405d-a689-53b93a94a56a req-eb1f6967-0b64-48b3-b21a-1803d4ff7f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195428b1-4838-4e80-b993-64ac7519a142", "name": "network-vif-deleted", "tag": "20a11076-ef2c-48a2-aec6-2353860b0954"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:11.415113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:11.415113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:11.426270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d92d420d-3672-405d-a689-53b93a94a56a req-eb1f6967-0b64-48b3-b21a-1803d4ff7f4e service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.427134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d92d420d-3672-405d-a689-53b93a94a56a req-eb1f6967-0b64-48b3-b21a-1803d4ff7f4e service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:11.465992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-d92d420d-3672-405d-a689-53b93a94a56a req-eb1f6967-0b64-48b3-b21a-1803d4ff7f4e service nova] Creating event network-vif-deleted:20a11076-ef2c-48a2-aec6-2353860b0954 for instance 195428b1-4838-4e80-b993-64ac7519a142 on hv-cinder-81920 Dec 16 17:57:11.475560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-d92d420d-3672-405d-a689-53b93a94a56a req-eb1f6967-0b64-48b3-b21a-1803d4ff7f4e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081349 Dec 16 17:57:11.478197 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 167/339] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:11.493113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:11.495441 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:11.507651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.511331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:11.513670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.514915 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:11.682355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.684453 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:11.688828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lazy-loading 'fault' on Instance uuid 195428b1-4838-4e80-b993-64ac7519a142 {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:57:11.880219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:11.891789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-909b7417-16f0-4c67-9a45-fe7917a60b1c tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 200 len: 1304 microversion: 2.1 time: 0.410296 Dec 16 17:57:11.902952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 168/340] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:11 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 1304 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:11.910582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3316652d-0a58-484d-9165-d51a39ab46f5"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:11.912076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:11.927464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.929802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:11.933086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:11.934224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.008994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] HTTP exception thrown: Cannot 'attach_volume' instance 71b128b8-90f3-4162-82d5-7b55358c2a7f while it is in vm_state rescued Dec 16 17:57:12.009607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Returning 409 to user: Cannot 'attach_volume' instance 71b128b8-90f3-4162-82d5-7b55358c2a7f while it is in vm_state rescued {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:57:12.010533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b2820ce7-5362-464b-a250-1e92aeafda0d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105922 Dec 16 17:57:12.017985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 169/341] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:57:11 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 17:57:12.029955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:12.031020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:12.043285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.044934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.044934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.045341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.172252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b7268c4b-e22f-4d12-8c41-b8f04629b6b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.153117 Dec 16 17:57:12.172904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 170/342] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:12 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:12.180532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:12.181155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:12.201186 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.201637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.202506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.202996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.397067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-292a763d-709a-4290-9c74-5504a15f3a07 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.222386 Dec 16 17:57:12.455454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 171/343] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:12 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:57:12.469668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:12.471113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:57:12.472391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:57:12.473414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:57:12.473978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:57:12.475401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:57:12.487786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:12.509676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.515521 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.517913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.519929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.532743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.533847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.542766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:12.543319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:12.569759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:12.582571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for user e85da5cbc170449cb9f74d845845bc35 and project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:12.611528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:57:12.631097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:57:12.741540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0424d14b-12fd-44e9-b3c3-606f84bce34f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979398 Dec 16 17:57:12.742360 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 173/344] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:57:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:57:12.767768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-448726349", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aad32db-9062-48c6-b8ca-474a8b1c9b58"}], "security_groups": [{"name": "tempest-securitygroup--1373690563"}], "key_name": "tempest-keypair-1873861498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:13.235155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] validate_networks() for [('3aad32db-9062-48c6-b8ca-474a8b1c9b58', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:57:14.010090 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:14.056647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-da8168d3-cac0-43ae-99b8-da7909c02305 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1510 microversion: 2.1 time: 1.599676 Dec 16 17:57:14.076497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 172/345] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:12 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1510 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:14.094751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:14.095762 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:14.104756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.105498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.106782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.119601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.351377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:14.363739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c1e39f02-c4a1-47b0-ab1b-412cce930b6f tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1221 microversion: 2.1 time: 0.285537 Dec 16 17:57:14.367684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 173/346] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:14 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:14.378921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:14.379530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 195428b1-4838-4e80-b993-64ac7519a142] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:14.421786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.423973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.423973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.424381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.493241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] HTTP exception thrown: Instance 195428b1-4838-4e80-b993-64ac7519a142 could not be found. Dec 16 17:57:14.494194 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Returning 404 to user: Instance 195428b1-4838-4e80-b993-64ac7519a142 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:57:14.495472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-01d699c1-d63f-4dab-93a8-d0102a77a672 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142" status: 404 len: 111 microversion: 2.1 time: 0.121871 Dec 16 17:57:14.496151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 174/347] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:14 2021] GET /compute/v2.1/servers/195428b1-4838-4e80-b993-64ac7519a142 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:57:14.510173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:14.524826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:14.541970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.542392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.543340 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:14.544034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:14.669334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-87aafa69-d4d8-48d3-8165-8db034c49116 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.171208 Dec 16 17:57:14.669994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 175/348] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:14 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:14.763307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1818737568", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "eec24439-f2c6-4e67-81a7-96a21069ee65"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:14.933671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] validate_networks() for [('eec24439-f2c6-4e67-81a7-96a21069ee65', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:57:15.005102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:57:15.006805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:57:15.006805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:57:15.007158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:57:15.013236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:57:15.046277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:15.052466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:15.057011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:15.059316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:15.137564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:15.163538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:15.252907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:57:15.261622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:57:15.428897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-75c97395-82f4-490f-917a-148ea253a466 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.685055 Dec 16 17:57:15.429571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 174/349] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Dec 16 17:57:12 2021] POST /compute/v2.1/servers => generated 402 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 17:57:15.445682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:15.446739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:15.460226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:15.460676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:15.461479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:15.461908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:15.977842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:15.992132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-53bf944a-ffe7-4423-a5ae-065ed3161ed9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1510 microversion: 2.1 time: 0.559089 Dec 16 17:57:16.007496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 175/350] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:15 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1510 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:16.026590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:16.031411 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:16.061547 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.062213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.075754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.075955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.247864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:16.255890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6d02c770-ed18-4e04-a310-1ea1bf77f50b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1275 microversion: 2.1 time: 0.245995 Dec 16 17:57:16.256478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 176/351] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:16 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:16.266078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:16.271686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:16.285150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.285599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.286408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.286875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.577749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:57:16.581348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:57:16.588152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:57:16.589503 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:57:16.591430 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:57:16.596706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:16.619947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:16.623797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:16.625836 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7651a03f-c204-4a1f-86c1-9fbd38e0d1a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1285 microversion: 2.20 time: 0.364869 Dec 16 17:57:16.626598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 177/352] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:16 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1285 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:16.634259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:16.635914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:16.649866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.650797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.651968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.652562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.658921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.661777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.682419 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:16.683208 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:16.804365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Getting quotas for project 9fd9aefb930a48bfaa54182fe6a4a20c. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:16.818338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Getting quotas for user 75f33f9ecdbf4e6ea3581cea3ab2ca16 and project 9fd9aefb930a48bfaa54182fe6a4a20c. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:16.820461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2e4afbba-06a5-4ecc-9c04-b9e9bcca2160 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.191945 Dec 16 17:57:16.825948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 178/353] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:16 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:16.852724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:57:16.857803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:57:16.922843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-875d1722-2a7b-4204-afcb-9ea01aed7b65 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185640 Dec 16 17:57:16.924878 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 176/354] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:57:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:57:16.938742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a5fd3453-f2fa-496b-b07a-0aa793893701 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:16.940403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a5fd3453-f2fa-496b-b07a-0aa793893701 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:17.020832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:17.023041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:17.051297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.053073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.054912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.059136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.137163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a5fd3453-f2fa-496b-b07a-0aa793893701 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:17.144833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a5fd3453-f2fa-496b-b07a-0aa793893701 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1214 microversion: 2.1 time: 0.213473 Dec 16 17:57:17.152860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 179/355] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:16 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:17.273525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:17.274312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:17.296962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.297358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.298605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.299300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.901452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:17.923989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-37899ecc-d262-4c73-84ed-0ff1f4232433 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.653956 Dec 16 17:57:17.924917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 180/356] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:17 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:17.931820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:17.932705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:17.945195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.946272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.948142 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:17.948861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:17.974561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:18.007242 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8c2de69e-f7da-463d-8615-4b6f0cc31056 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1510 microversion: 2.1 time: 0.995128 Dec 16 17:57:18.010272 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 177/357] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:17 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1510 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:18.015330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:18.016315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:18.046891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.047597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:18.048552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.049321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:18.188742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3ca8de57-8a67-4cb9-8cab-63761636a87d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28166 microversion: 2.1 time: 0.176687 Dec 16 17:57:18.189916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:18.190892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 178/358] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:18 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28166 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:18.221368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:18.223141 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:18.229754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:18.238425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:18.244374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-193bf930-3cec-41ac-8142-205a9cca6e6f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1339 microversion: 2.20 time: 0.317713 Dec 16 17:57:18.245861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 181/359] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:17 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:18.258906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.260191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:18.261122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.264925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:18.501613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:18.528823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8731f9df-948c-45df-a73c-91f6a3bb3b30 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1266 microversion: 2.1 time: 0.335001 Dec 16 17:57:18.529866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 179/360] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:18 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:18.942052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:18.942052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:18.953008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.953848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:18.954780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:18.955209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.027217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:19.028526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:19.035345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.036039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.037002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.037846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.335117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:19.346858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-45638518-4240-4106-9a38-cf0be855c40e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.409599 Dec 16 17:57:19.349273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 182/361] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:18 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:19.354193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-75c7b767-8450-48d2-a390-34f12b5d9e8e req-9b6862b0-14e7-4d48-ad36-a67a35d60e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6", "tag": "93eaa60f-c9d3-436e-8948-b358e656df71"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:19.356403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:19.356403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:57:19.390405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75c7b767-8450-48d2-a390-34f12b5d9e8e req-9b6862b0-14e7-4d48-ad36-a67a35d60e96 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.392378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75c7b767-8450-48d2-a390-34f12b5d9e8e req-9b6862b0-14e7-4d48-ad36-a67a35d60e96 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.436477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-75c7b767-8450-48d2-a390-34f12b5d9e8e req-9b6862b0-14e7-4d48-ad36-a67a35d60e96 service nova] Creating event network-changed:93eaa60f-c9d3-436e-8948-b358e656df71 for instance 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 on hv-cinder-81920 Dec 16 17:57:19.459243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-75c7b767-8450-48d2-a390-34f12b5d9e8e req-9b6862b0-14e7-4d48-ad36-a67a35d60e96 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096242 Dec 16 17:57:19.460604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 183/362] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:19.473884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:19.476400 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:19.498451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.499044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.500312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.500990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.644332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fe6fe14f-1873-4e7a-a03a-0db76eb29105 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28454 microversion: 2.1 time: 0.181415 Dec 16 17:57:19.648210 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 184/363] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:19 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:19.654726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:19.657870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:19.680119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.680565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.688240 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.689464 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.884721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:19.900764 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:19.902440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:19.914213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3e251144-b678-462b-9be8-e2b425e555b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1339 microversion: 2.20 time: 0.263801 Dec 16 17:57:19.915736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 185/364] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:19 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1339 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:19.930416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:19.931071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:19.947550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.948499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:19.949507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:19.950088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:20.115315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:20.120201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:20.135129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e5846182-7970-4e9d-a3b0-f533287ab7ff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1272 microversion: 2.1 time: 0.215716 Dec 16 17:57:20.136043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 186/365] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:19 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:20.136882 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-39c324db-4af8-4dc4-b55c-a295aacf71ec tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1516 microversion: 2.1 time: 1.113684 Dec 16 17:57:20.138122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 180/366] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:19 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1516 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:20.366378 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:20.367298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:20.385768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:20.386995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:20.395216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:20.396748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:20.490582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Action: 'create', calling method: .version_select at 0x7fca1c2d01f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-503061536"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:20.532727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:20.539188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for user 8317cb247b074647a1788f28f986ebc6 and project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:20.738893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:20.745312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for user 8317cb247b074647a1788f28f986ebc6 and project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:20.783967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-06e5eec7-6ae8-47ca-96ce-4924bae6f764 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.643720 Dec 16 17:57:20.785093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 187/367] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Dec 16 17:57:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:20.792971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:20.807268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:20.817191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:20.817931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:20.819149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:20.819868 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.095628 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5dc53e0a-158c-4119-9171-2fc917131219 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28454 microversion: 2.1 time: 0.308706 Dec 16 17:57:21.100327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 188/368] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:20 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28454 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:21.109127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:21.115508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:21.132893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.133606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.135991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.139484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.220747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:21.231874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e17d6a1a-8425-469e-9649-78bc1e459a03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.870361 Dec 16 17:57:21.232474 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 181/369] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:20 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:21.240728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:21.241761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:21.264644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.266851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.268275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.269081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.348232 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:21.368680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:21.374024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:21.375424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f5fc0865-1cf0-4223-9c11-531e9731d421 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1339 microversion: 2.20 time: 0.271821 Dec 16 17:57:21.385590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 189/370] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:21 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:21.488582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:21.508811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-72398cde-1d8d-41ac-92f5-306e00e7eab6 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1272 microversion: 2.1 time: 0.272992 Dec 16 17:57:21.512999 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 182/371] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:21 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:21.758418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:21.759019 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:21.785601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.786237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:21.787262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:21.787703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.109081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:22.110233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:22.125068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.125951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.127002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.131699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.243708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a7a0b987-84c3-4f20-a669-6cdb158e2b27 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.136741 Dec 16 17:57:22.244419 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 183/372] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:22 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:22.249685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:22.250405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:22.266671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.268449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.271158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.272345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.303264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:22.315574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-861c253b-ec6c-416d-a4ac-0bad00d9c5f4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1516 microversion: 2.1 time: 0.561537 Dec 16 17:57:22.316665 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 190/373] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:21 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1516 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:22.336026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1125f11-871a-4241-9d86-d19fdf12aab2"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:22.337590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:22.348750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.349271 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.351342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.352300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.902880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1f6a8460-fcf7-4c47-8237-7d200c131426 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571631 Dec 16 17:57:22.903661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 191/374] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:57:22 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:22.944272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:22.945715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:22.958718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.959138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:22.967246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:22.968194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:23.006867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:23.019291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2896caaa-1ec9-4d07-be56-d2621cdcec99 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.770026 Dec 16 17:57:23.022235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 184/375] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:22 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:23.032294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:23.036559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:23.050128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:23.053256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:23.054592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:23.055044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:23.290409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:23.333204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:23.342472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:23.344489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ee3f8a91-b7e4-4dd6-a482-96537055ba39 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.416762 Dec 16 17:57:23.345779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 192/376] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:22 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:23.354086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:23.364982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:23.376713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:23.377150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:23.387239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:23.387978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:23.694960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-767f9092-a34a-4990-b404-ffd7b67913d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.346392 Dec 16 17:57:23.696539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 193/377] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:23 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:23.838076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:23.858574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b9034e41-5fca-47b3-8bf7-f7456cc6681b tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.834908 Dec 16 17:57:23.867236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 185/378] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:23 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:24.051278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:24.053976 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:24.074329 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.078009 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.079457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.081499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.370286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:24.371344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:24.388677 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.390116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.391321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.391789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.422375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:24.445989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-89e2785c-a805-4811-ade3-94db767010e5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.400189 Dec 16 17:57:24.448958 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 194/379] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:24 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:24.707721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:24.708686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:24.722494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.723207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.724632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.725344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.825440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0888ed14-fafb-45e3-add5-b1af7a9158fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.120957 Dec 16 17:57:24.827051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 195/380] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:24 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:24.842997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-56f87aa5-3460-4a4a-b3d6-9082c1fd0e25 req-0a97a32c-b4af-4522-b6b1-2c7017d8ced8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:24.847068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:24.847068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:57:24.856930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-56f87aa5-3460-4a4a-b3d6-9082c1fd0e25 req-0a97a32c-b4af-4522-b6b1-2c7017d8ced8 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.857710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-56f87aa5-3460-4a4a-b3d6-9082c1fd0e25 req-0a97a32c-b4af-4522-b6b1-2c7017d8ced8 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.870842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-56f87aa5-3460-4a4a-b3d6-9082c1fd0e25 req-0a97a32c-b4af-4522-b6b1-2c7017d8ced8 service nova] Creating event network-changed:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 17:57:24.876492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-56f87aa5-3460-4a4a-b3d6-9082c1fd0e25 req-0a97a32c-b4af-4522-b6b1-2c7017d8ced8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047446 Dec 16 17:57:24.878899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 196/381] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:24.890937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:24.892672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:24.906090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.907248 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:24.908292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:24.908928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:25.207317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:25.229915 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:25.238446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:25.241014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:25.242402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bedea479-574f-46c6-9181-efcdadeaa419 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.876418 Dec 16 17:57:25.243599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 186/382] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:24 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:57:25.245112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8afc6472-f058-4c1e-8af7-ee9ed2d71439 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.346367 Dec 16 17:57:25.247540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 197/383] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:24 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:25.249988 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2001437500", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d8330e09-9a25-4fb2-9600-d502f13c3fd4"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:25.313013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] validate_networks() for [('d8330e09-9a25-4fb2-9600-d502f13c3fd4', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:57:25.466571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:25.467776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:25.475942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:25.481541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:25.482601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:25.483655 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:25.684761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:25.695170 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d6039dbb-9516-4eb3-be4f-77faa6ed3dc4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.232288 Dec 16 17:57:25.696167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 198/384] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:25 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:25.847700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:25.850160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:25.861976 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:25.863208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:25.864616 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:25.865456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:25.948779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9d8ae6ac-29f8-4dce-9ae1-87210648ca22 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.110224 Dec 16 17:57:25.950856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 199/385] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:25 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:26.193325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:57:26.193750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:57:26.194262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:57:26.194938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:57:26.195356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:57:26.209960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.210949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.212808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.213993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.252856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Getting quotas for project e1d5cb18f27d4ce1a89b1f5698ebcbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:57:26.263261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Getting quotas for user b1a1432173174bfd86f945f8ea925934 and project e1d5cb18f27d4ce1a89b1f5698ebcbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:57:26.263557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:26.264286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:26.277043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.277813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.278718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.279333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.285764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:57:26.291177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:57:26.388538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-52bb3cc5-ce31-45b9-bf2d-1daa46a5955c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143317 Dec 16 17:57:26.396488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 187/386] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:57:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:57:26.396488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:26.396488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:26.404972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.405934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.407396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.408087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.561950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.571083 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0cf86c6f-7864-463a-a812-8a5b18e43df2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.312402 Dec 16 17:57:26.573937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 200/387] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:26 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:26.583236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-82f7a60c-b93a-4027-a0eb-991004e77335 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:26.584129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-82f7a60c-b93a-4027-a0eb-991004e77335 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:26.677092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-82f7a60c-b93a-4027-a0eb-991004e77335 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.685540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-82f7a60c-b93a-4027-a0eb-991004e77335 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1219 microversion: 2.1 time: 0.108303 Dec 16 17:57:26.686173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 201/388] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:26 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:26.713968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:26.714604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:26.725825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.726285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.727130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.727577 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.791700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.813620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.817911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.821893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8eb005ab-ba23-47cf-9eeb-58e31d366b07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.429945 Dec 16 17:57:26.823870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 188/389] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:26 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:26.938458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:26.948880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-850fe2fd-1012-4d6d-b39e-5828daf1db60 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.240069 Dec 16 17:57:26.951204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-8a513e72-7e1c-49b0-969e-58f9c14cff76 req-8adde503-1d52-4046-aaa1-930c43a430f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345afa0a-e4be-42d8-869a-ee8774b777f2", "tag": "91aec430-6b62-412b-a19f-511a7db58d0b"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:26.951532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 202/390] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:26 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:26.953034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:26.953034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:26.965749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:26.966688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:26.967564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8a513e72-7e1c-49b0-969e-58f9c14cff76 req-8adde503-1d52-4046-aaa1-930c43a430f6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.968365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8a513e72-7e1c-49b0-969e-58f9c14cff76 req-8adde503-1d52-4046-aaa1-930c43a430f6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.976558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.977287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.978273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:26.978736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:26.992261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-8a513e72-7e1c-49b0-969e-58f9c14cff76 req-8adde503-1d52-4046-aaa1-930c43a430f6 service nova] Creating event network-changed:91aec430-6b62-412b-a19f-511a7db58d0b for instance 345afa0a-e4be-42d8-869a-ee8774b777f2 on hv-cinder-81920 Dec 16 17:57:27.011957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-8a513e72-7e1c-49b0-969e-58f9c14cff76 req-8adde503-1d52-4046-aaa1-930c43a430f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066675 Dec 16 17:57:27.013316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 189/391] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:57:27.233589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d12bb0c0-b4db-45d9-9e15-75e966919680 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.273760 Dec 16 17:57:27.238163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 203/392] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:26 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:27.591716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:27.592960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:27.600319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.600319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.600623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.601035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.704762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:27.705606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:27.712841 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.713284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.714082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.714517 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.771945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:27.779506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-598eccc8-3643-4c94-9c71-957ae1c262d2 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.192505 Dec 16 17:57:27.780322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 190/393] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:27 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:27.788310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:27.798468 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-57e17723-9cc5-4d9c-8286-d638f6e23304 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1271 microversion: 2.1 time: 0.098377 Dec 16 17:57:27.799146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 204/394] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:27 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:27.842758 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:27.843457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:27.850556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.851175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.852072 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.852574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.974653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:27.975389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:27.983761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.984364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:27.985296 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:27.985830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.051083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:28.063562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:28.065824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:28.067814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bba94921-b946-4ae8-9de1-d3d04015a565 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.228951 Dec 16 17:57:28.069264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 191/395] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:27 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:28.193024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:28.201416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-45825b7f-882f-4dde-96ea-64aa6af5c068 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.234290 Dec 16 17:57:28.202158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 205/396] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:27 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:28.250443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:28.251507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:28.258755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.259231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.260101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.260553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.473513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a0a650c5-5de3-4f5c-86a9-eb820d57bb39 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.229506 Dec 16 17:57:28.474422 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 192/397] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:28 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:28.806201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:28.807096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:28.815880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.816626 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.817730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.818172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.818548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:28.819946 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:28.829226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.829672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.830466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:28.831090 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:28.994094 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.003977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-50e808bb-6b72-454e-9dd7-a196cffc9f74 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.210763 Dec 16 17:57:29.004607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 206/398] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:28 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:29.078951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.090070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:29.090925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:29.093364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ddefc3ae-13d5-4bcd-85b2-d79af57405c8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.279804 Dec 16 17:57:29.093973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 193/399] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:28 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:29.098690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.099474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.100336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.100770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.225867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:29.248929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:29.264637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.265241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.266070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.266566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.270734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.280224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.281535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.282696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-100627a2-10dd-49e4-b326-b58f39182893 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.197120 Dec 16 17:57:29.283604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 207/400] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:29 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:29.486234 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:29.487410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:29.494370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.494930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.495825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:29.496332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:29.690861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e4895846-619d-499e-b2e3-c87ecddb3f58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.208768 Dec 16 17:57:29.692499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 208/401] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:29 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:29.791671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:29.800998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-42e97bb3-ef25-4011-868f-a05a4585bb90 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.585762 Dec 16 17:57:29.805589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 194/402] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:29 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:30.025104 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-d42abb75-5639-4e03-97d5-349a51129f9b req-aaed52c9-fd33-4cad-95b2-5de121061459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536e020a-872b-41cf-989e-192d42b2a8fb", "tag": "53b232b2-b611-4e27-ba0c-c56824b7721b"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:30.026783 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:30.026783 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:30.036373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d42abb75-5639-4e03-97d5-349a51129f9b req-aaed52c9-fd33-4cad-95b2-5de121061459 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.036602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:30.037507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:30.038183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d42abb75-5639-4e03-97d5-349a51129f9b req-aaed52c9-fd33-4cad-95b2-5de121061459 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.045600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.046005 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.047993 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.050280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.052718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-d42abb75-5639-4e03-97d5-349a51129f9b req-aaed52c9-fd33-4cad-95b2-5de121061459 service nova] Creating event network-changed:53b232b2-b611-4e27-ba0c-c56824b7721b for instance 536e020a-872b-41cf-989e-192d42b2a8fb on hv-cinder-81920 Dec 16 17:57:30.066383 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-d42abb75-5639-4e03-97d5-349a51129f9b req-aaed52c9-fd33-4cad-95b2-5de121061459 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040003 Dec 16 17:57:30.067115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 195/403] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:30.117352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:30.118299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:30.125690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.126404 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.127436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.128038 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.226030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:30.234635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-825e5977-7df7-483e-a93d-a9d7751ff952 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.216347 Dec 16 17:57:30.244742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 209/404] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:30 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:30.319556 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:30.320149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:30.328975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.329719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.330766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.332708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.486425 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:30.503721 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4c8fffe9-5ae5-415a-870b-228a1c8aa3ec tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.393333 Dec 16 17:57:30.505056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 196/405] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:30 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:30.539422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:30.556780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:30.561059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:30.562781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-52352c45-e8f1-4905-a1ee-fdb4c129bd69 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.264023 Dec 16 17:57:30.563906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 210/406] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:30 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:30.578785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-70ab266e-4812-44c9-a8d2-888b33a9cdb2 req-dd19eb6f-6c32-4818-841a-e1e098c72551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6", "name": "network-vif-plugged", "status": "completed", "tag": "93eaa60f-c9d3-436e-8948-b358e656df71"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:30.580373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:30.580373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:30.588568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-70ab266e-4812-44c9-a8d2-888b33a9cdb2 req-dd19eb6f-6c32-4818-841a-e1e098c72551 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.589550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-70ab266e-4812-44c9-a8d2-888b33a9cdb2 req-dd19eb6f-6c32-4818-841a-e1e098c72551 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.617211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-70ab266e-4812-44c9-a8d2-888b33a9cdb2 req-dd19eb6f-6c32-4818-841a-e1e098c72551 service nova] Creating event network-vif-plugged:93eaa60f-c9d3-436e-8948-b358e656df71 for instance 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 on hv-cinder-81920 Dec 16 17:57:30.631363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-70ab266e-4812-44c9-a8d2-888b33a9cdb2 req-dd19eb6f-6c32-4818-841a-e1e098c72551 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056703 Dec 16 17:57:30.632509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 197/407] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:30.706842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:30.707996 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:30.716002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:30.718475 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:30.732900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.735196 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.736172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.737166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.737648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.741461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.742355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:30.742813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:30.798472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lazy-loading 'flavor' on Instance uuid 71b128b8-90f3-4162-82d5-7b55358c2a7f {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:57:30.986843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-47f69590-aac0-40ca-b4d0-bf410a4e6f46 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action" status: 200 len: 32 microversion: 2.1 time: 0.276265 Dec 16 17:57:30.990776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 198/408] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:30 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:57:31.001505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:31.002871 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:31.017936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.018758 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.019885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.020439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.217481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.226075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-af682d8c-77e7-40f8-844f-54ceee712e4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.230002 Dec 16 17:57:31.226744 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 199/409] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:30 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:31.231135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:31.231724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:31.239188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.239774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.240673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.241129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.402075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.412033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-aa482f88-b614-4623-a447-e302891a11a9 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.184226 Dec 16 17:57:31.412639 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 200/410] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:31 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:31.419703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:31.420547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:31.427402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.428365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.429574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.430220 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.689393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e9347cfd-46fa-40dc-b4c5-3ca1ac9d917f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.987321 Dec 16 17:57:31.690798 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 211/411] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:30 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:31.697049 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:31.698239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:31.698437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.707291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-acb8176a-f733-4257-b4b0-a3279fa499ca tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.293327 Dec 16 17:57:31.707888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 201/412] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:31 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:31.708156 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.708638 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.709485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.709913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.715557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:31.716487 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:31.723673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.724527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.725656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:31.726315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:31.944993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.956080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.957591 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.958781 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bd542160-ec12-45ee-9453-5be0133abc3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.248967 Dec 16 17:57:31.959350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 202/413] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:31 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:31.974432 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:31.982847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3093d041-85f3-43a4-b63b-a39c8e4a44ea tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.289988 Dec 16 17:57:31.983492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 212/414] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:31 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:32.244590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:32.245355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:32.253163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.253602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.254388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.254855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.424884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:32.437094 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:32.437518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-25d772ad-e79a-4286-938e-0571d45ea09a tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.196923 Dec 16 17:57:32.437866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:32.438361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 203/415] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:32 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:32.445421 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.445861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.446887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.447339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.602586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:32.611184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c49245c4-870e-4fb0-b1ce-dff79ece2a60 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.178320 Dec 16 17:57:32.611896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 213/416] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:32 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:32.705563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:32.706566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:32.712800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.713255 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.714038 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.714640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.724374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:32.724994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:32.733967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.734378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.735330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.735999 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.880779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:32.890115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3970857a-07f6-477e-8f69-e59998465267 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.169446 Dec 16 17:57:32.892394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 214/417] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:32 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:32.927629 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc149a80-a87e-44a2-9e5b-c7d9fc07efe3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.225750 Dec 16 17:57:32.928338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 204/418] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:32 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:32.981283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:32.981944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:32.989380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.989921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:32.990910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:32.991564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.000259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:33.001056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:33.008348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.008792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.009981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.010610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.151754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.163986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.165510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.166682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a2223a3c-2138-4f55-9067-4582e4b49540 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.192239 Dec 16 17:57:33.167274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 215/419] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:32 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:33.183522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.191458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8d730e13-1c6e-4bf4-81d9-748fa4e16b4e tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.196344 Dec 16 17:57:33.192030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 205/420] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:32 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:33.458490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:33.459446 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:33.473313 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.473898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.475129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.475928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.631959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:33.632689 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:33.636383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.640059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.640720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.641635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.642062 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.646536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b34e08cd-ffa8-4aad-8d56-c2a019f41efe tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1317 microversion: 2.1 time: 0.195144 Dec 16 17:57:33.649091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 216/421] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:33 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:33.802349 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:33.812834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8edece79-8de0-4256-a365-dde43c172dd7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.186335 Dec 16 17:57:33.813435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 206/422] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:33 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:33.910470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:33.911329 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:33.920135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.920970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.922121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.922872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.940977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:33.941930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:33.947971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.948435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:33.949204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:33.949648 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.078935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.079840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cc90f622-321b-4b4b-9cfd-6be4415fe177 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.143023 Dec 16 17:57:34.080532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 207/423] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:33 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:34.087346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e8238e89-44e2-4f2c-b907-5c2389596dff tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.180534 Dec 16 17:57:34.087912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 217/424] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:33 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:34.187764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:34.188497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:34.195920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.196362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.197139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.197566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.209896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:34.211051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:34.223978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.224734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.226130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.226950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.368971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.378314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.379860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.380982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b659097e-3f9a-48bb-bc01-a01fd55bc992 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.198217 Dec 16 17:57:34.381555 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 208/425] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:34 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:34.399701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.407353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a956e80b-7c2c-44d0-897a-924bbe592a61 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.202331 Dec 16 17:57:34.407920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 218/426] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:34 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:34.672600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:34.674903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:34.684830 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.685354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.686352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.687032 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.831999 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:34.832628 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:34.839239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.839829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.840611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:34.841040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:34.845207 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:34.852945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e4458a21-36bf-41a9-a35c-8e660edebcb6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1507 microversion: 2.1 time: 0.189269 Dec 16 17:57:34.854687 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 209/427] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:34 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:35.002898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.013326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a2000418-512e-4f03-9155-a0e3baaaf12b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.186355 Dec 16 17:57:35.013951 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 219/428] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:34 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:35.093887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:35.095455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:35.106908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:35.106908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:35.114349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.114560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.114857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.115224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.115654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.116095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.117288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.118299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.219659 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d376f9ce-bd57-4f56-a3b4-80841d185f4b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.131001 Dec 16 17:57:35.223654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 210/429] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:35 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:35.293499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.304326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ec5ec19d-749f-45ee-864b-014ab2321578 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.202180 Dec 16 17:57:35.305270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 220/430] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:35 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:35.404846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:35.405416 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:35.412795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.413238 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.414026 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.414457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.426575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:35.427226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:35.434113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.434562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.435407 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:35.435836 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:35.565984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.578498 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.584565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.586737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:35.587039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-999d6705-6e73-477f-9ad2-fb1f4c57b31c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.164204 Dec 16 17:57:35.587857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-60ba44a3-7ace-4a94-b8b8-f63d071bf87b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.188281 Dec 16 17:57:35.588602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 211/431] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:35 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:35.591305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 221/432] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:35 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:36.032251 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:36.032831 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:36.039309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.039775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.040533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.040962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.184557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.194040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-16d7f096-b7cf-4c8c-98aa-4ce6ad3c0ebf tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.165807 Dec 16 17:57:36.194659 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 212/433] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:36 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:36.232991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:36.234215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:36.242700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.243354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.244393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.244984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.321588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:36.322193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:36.331272 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.331630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.332421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.332850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.450241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e26a2435-cdfa-4388-9074-2dbeab5a40dc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.221437 Dec 16 17:57:36.451379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 222/434] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:36 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:36.498205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-2d0b265d-ef7a-401a-bfb6-091681d45d83 req-d8861737-5d61-4105-a740-1573ffe4c0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345afa0a-e4be-42d8-869a-ee8774b777f2", "name": "network-vif-plugged", "status": "completed", "tag": "91aec430-6b62-412b-a19f-511a7db58d0b"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:36.500069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:36.500069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:57:36.508615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-2d0b265d-ef7a-401a-bfb6-091681d45d83 req-d8861737-5d61-4105-a740-1573ffe4c0c7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.509341 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-2d0b265d-ef7a-401a-bfb6-091681d45d83 req-d8861737-5d61-4105-a740-1573ffe4c0c7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.522936 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-2d0b265d-ef7a-401a-bfb6-091681d45d83 req-d8861737-5d61-4105-a740-1573ffe4c0c7 service nova] Creating event network-vif-plugged:91aec430-6b62-412b-a19f-511a7db58d0b for instance 345afa0a-e4be-42d8-869a-ee8774b777f2 on hv-cinder-81920 Dec 16 17:57:36.525559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.528229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-2d0b265d-ef7a-401a-bfb6-091681d45d83 req-d8861737-5d61-4105-a740-1573ffe4c0c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Dec 16 17:57:36.529704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 223/435] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:36.537636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-17ca09af-0e57-4e6a-978a-3e38e05a0244 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.219697 Dec 16 17:57:36.554767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 213/436] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:36 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:36.606837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:36.608011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:36.609295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:36.610983 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:36.615355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.615917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.616818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.617348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.637692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.638161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.639079 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:36.639523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:36.796043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.813464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.818054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.819581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-13ff3da2-7588-47f7-84b5-2793a5da1761 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.217708 Dec 16 17:57:36.820944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 214/437] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:36 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 17:57:36.891805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:36.899335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c0006ebe-eadd-404e-bc63-0171935e287d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.296896 Dec 16 17:57:36.909507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 224/438] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:36 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:37.221893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:37.222567 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.231667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.232087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.232886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.233315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.313228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6a478ee-2b08-4943-a033-6b5bca0e4d36"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:37.314425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.320816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.321252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.322045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.322457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.388516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:37.400025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-10e58a18-7049-492b-bc3b-a0237cc82a97 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.182341 Dec 16 17:57:37.400706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 215/439] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:37 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:37.465040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:37.467301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.474114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.474562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.475401 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.475839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.580477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f0a76e81-91b2-4e64-a823-8948bedcf98a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.120691 Dec 16 17:57:37.581091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 216/440] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:37 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:37.597220 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:37.598372 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.609620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.610270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.611210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.611948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.649793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-883cc016-43cb-4684-9003-b96178857c7c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340297 Dec 16 17:57:37.650626 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 225/441] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:57:37 2021] POST /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:57:37.782386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:37.795444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f3c256b3-cec0-40b7-bf25-c18bbb1d3521 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.212578 Dec 16 17:57:37.796558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 217/442] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:37 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:37.843449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:37.843449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.852303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.852752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.853561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.857806 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.916186 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:37.916712 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:37.925376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.925822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:37.926702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:37.927131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.013814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:38.024564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:38.026130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:38.027385 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b047cdb3-d264-458d-a5fc-5314528cb3c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.192342 Dec 16 17:57:38.027944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 226/443] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:37 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:57:38.083173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:38.091158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0953f95b-4088-4428-a47b-14f993b79bda tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.178709 Dec 16 17:57:38.092128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 218/444] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:37 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:38.417458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:38.418284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:38.426078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.426524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.427351 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.427786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.552058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-399f7603-b943-4bc0-af6d-f0d0c4451445 req-9323bcb2-53c4-4a44-a5d1-8cc511050671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "name": "network-vif-plugged", "status": "completed", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:38.554925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:38.554925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:38.567970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-399f7603-b943-4bc0-af6d-f0d0c4451445 req-9323bcb2-53c4-4a44-a5d1-8cc511050671 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.568926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-399f7603-b943-4bc0-af6d-f0d0c4451445 req-9323bcb2-53c4-4a44-a5d1-8cc511050671 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.580912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-399f7603-b943-4bc0-af6d-f0d0c4451445 req-9323bcb2-53c4-4a44-a5d1-8cc511050671 service nova] Creating event network-vif-plugged:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 17:57:38.586395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-399f7603-b943-4bc0-af6d-f0d0c4451445 req-9323bcb2-53c4-4a44-a5d1-8cc511050671 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040845 Dec 16 17:57:38.587528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 219/445] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:38.594937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:38.596175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:38.603028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.603467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.604255 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.604680 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.606675 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:38.617255 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4b690672-4425-4085-81e5-c56b00c27b1d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.203265 Dec 16 17:57:38.628273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 227/446] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:38 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:38.820259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:38.820870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:38.828137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.828644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:38.829751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:38.830194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.009016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.017260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-16f54ec3-f705-4742-a1a9-7e2e2749cad7 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1314 microversion: 2.1 time: 0.200543 Dec 16 17:57:39.017856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 228/447] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:38 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:39.045854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:39.046337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:39.052530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.052968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.053747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.054167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.213891 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.224094 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.225783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.227090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-31b6d03a-b9c7-4ee1-8329-854547e2d3b9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.185353 Dec 16 17:57:39.227654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 229/448] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:39 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:57:39.232380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:39.232976 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:39.239924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.240364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.241360 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.241941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.371337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ccdbe0d8-7f79-413f-8c89-9634d41bf281 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.781554 Dec 16 17:57:39.372767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 220/449] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:38 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:39.392204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.400139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1ee8747d-7311-4555-86dc-210218078436 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.171509 Dec 16 17:57:39.400717 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 230/450] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:39 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:39.637465 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:39.638182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:39.645633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.646080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.646918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:39.647353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:39.808842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:39.824067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3fc99b19-56a7-48a8-8137-610be6e56ed8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.192276 Dec 16 17:57:39.824804 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 221/451] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:39 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:40.034320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:40.035144 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.046845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.047349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.048186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.048767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.224451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:40.241127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-793356d1-c685-414a-8757-63811288c871 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1498 microversion: 2.1 time: 0.207822 Dec 16 17:57:40.242492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 231/452] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:40 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:40.255149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:40.256303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.272183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.273202 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.274731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.275532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.386148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:40.390818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.406286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.408983 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.410097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.410479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.490005 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:40.498910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:40.500437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:40.501573 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9817893c-c2a3-4fee-992b-909a4bfde716 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1407 microversion: 2.20 time: 0.259158 Dec 16 17:57:40.513805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 222/453] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:40 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:57:40.518951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:40.519590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.526019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.526493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.527316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.527802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.539123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ea243f32-5269-4c1e-a9f6-b8b231c404b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.157032 Dec 16 17:57:40.539777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 232/454] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:40 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:40.603939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-7d9380f1-efef-4d49-90bb-c5b8b9148f14 req-aabf993c-dedf-4226-8977-1443147eeb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536e020a-872b-41cf-989e-192d42b2a8fb", "name": "network-vif-plugged", "status": "completed", "tag": "53b232b2-b611-4e27-ba0c-c56824b7721b"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:40.606101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:40.606101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:57:40.621227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-7d9380f1-efef-4d49-90bb-c5b8b9148f14 req-aabf993c-dedf-4226-8977-1443147eeb88 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.621986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-7d9380f1-efef-4d49-90bb-c5b8b9148f14 req-aabf993c-dedf-4226-8977-1443147eeb88 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.642612 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-7d9380f1-efef-4d49-90bb-c5b8b9148f14 req-aabf993c-dedf-4226-8977-1443147eeb88 service nova] Creating event network-vif-plugged:53b232b2-b611-4e27-ba0c-c56824b7721b for instance 536e020a-872b-41cf-989e-192d42b2a8fb on hv-cinder-81920 Dec 16 17:57:40.651858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-7d9380f1-efef-4d49-90bb-c5b8b9148f14 req-aabf993c-dedf-4226-8977-1443147eeb88 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051598 Dec 16 17:57:40.653112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 233/455] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:40.705772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:40.716190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-435786db-1eee-47b3-9699-687038cddfb6 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.212363 Dec 16 17:57:40.717153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 223/456] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:40 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:40.845143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:40.845784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.850934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:40.851884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:40.855126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.855654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.856712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.857328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.859745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.860222 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.861335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:40.861982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:40.905253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:57:41.025544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ba8916de-8c80-4ad3-8d55-c3987e99f684 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "DELETE /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 204 len: 0 microversion: 2.1 time: 0.185807 Dec 16 17:57:41.026314 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 234/457] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:57:40 2021] DELETE /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:57:41.039498 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:41.040904 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:41.049135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.049676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.050523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.051133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.059605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.069204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6b32c1fb-db5a-48bb-8ab6-c5ff936b26f1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.221995 Dec 16 17:57:41.070026 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 224/458] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:40 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:41.202174 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.215869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ad8578d6-3304-4cd1-8e46-b10e4dc7dfb5 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1504 microversion: 2.1 time: 0.183183 Dec 16 17:57:41.218058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 235/459] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:41 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:41.525858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:41.526505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:41.533150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.533817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.534439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.534952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.554373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:41.555542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:41.563913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.564668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.565686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.566393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.683341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.684896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e84beb56-53aa-439e-83b9-29847ac681af tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.136606 Dec 16 17:57:41.689457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 236/460] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:41 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:41.693755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.695435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.696760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1e038ddb-f4d6-4d48-a564-ba265b27cb0f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1599 microversion: 2.20 time: 0.175085 Dec 16 17:57:41.698092 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 225/461] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 17:57:41 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 17:57:41.715977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:41.716592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:41.724152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.724594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.725383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.725810 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.734363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:41.735065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:41.741252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.741702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.742493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:41.742952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:41.821309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c4156f89-82e5-4de4-9d62-d846f366d02c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109453 Dec 16 17:57:41.821898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 237/462] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Dec 16 17:57:41 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:41.912444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:41.920791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b99808cb-dd5e-46d7-b218-894c28da2ee7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.190300 Dec 16 17:57:41.921384 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 226/463] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:41 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:42.087692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:42.088434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:42.109337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.109797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.110596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.111115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.237261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:42.238274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:42.277932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.279116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.282835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.288434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.422946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:42.435895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8fe98b70-739e-4b8a-b6ca-00b543497ef0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.351877 Dec 16 17:57:42.436701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 238/464] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:42 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:42.466333 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:42.475208 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-61cf7fec-78be-4471-89c1-3703fbfb57f3 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1504 microversion: 2.1 time: 0.241692 Dec 16 17:57:42.475838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 227/465] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:42 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:42.696808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:42.697927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:42.705967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.706591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.707460 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.707895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.808478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6a7e88ee-c3f1-4d14-ae86-90090f0c325a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.115148 Dec 16 17:57:42.813088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 239/466] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:42 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:42.938483 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:42.939203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:42.945282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.945744 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:42.946524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:42.947065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.096853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:43.110392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-708f8c6b-fdac-4af1-a4bc-6bbada243cc7 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1319 microversion: 2.1 time: 0.175509 Dec 16 17:57:43.111060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 228/467] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:42 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:43.437409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:43.443590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:43.443849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-c6d068c4-bd65-4adc-bd3f-9afa9dc02ad9 req-e68b1edd-9307-40b9-bf4a-3677b7171276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:43.443849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:43.443849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:57:43.461465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.462148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.463069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.463574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.471921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-c6d068c4-bd65-4adc-bd3f-9afa9dc02ad9 req-e68b1edd-9307-40b9-bf4a-3677b7171276 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.473919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-c6d068c4-bd65-4adc-bd3f-9afa9dc02ad9 req-e68b1edd-9307-40b9-bf4a-3677b7171276 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.492558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-c6d068c4-bd65-4adc-bd3f-9afa9dc02ad9 req-e68b1edd-9307-40b9-bf4a-3677b7171276 service nova] Creating event network-changed:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 17:57:43.498528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-c6d068c4-bd65-4adc-bd3f-9afa9dc02ad9 req-e68b1edd-9307-40b9-bf4a-3677b7171276 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062257 Dec 16 17:57:43.499187 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 229/468] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:43.507779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:43.508880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:43.515834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.516423 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.517318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.517841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.701186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e3c74481-8124-4782-bac8-fab11534745e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 0.268576 Dec 16 17:57:43.705184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 240/469] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:43 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:43.711919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:43.713223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:43.722685 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.723552 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.724489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.725146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.735223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:43.743839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ab42f08d-42bc-4f3c-a4fb-b986147f8a71 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.240138 Dec 16 17:57:43.744638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 230/470] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:43 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:43.823744 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:43.824698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:43.844183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.846710 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.847635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:43.848073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:43.980936 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:43.981180 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-20110279-f8ad-4ef7-b5ea-528dd2d2ace0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.159742 Dec 16 17:57:43.981895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 231/471] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:43 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:43.993192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-af93f7f0-a73d-4be6-b94d-2a0863621b1d tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1504 microversion: 2.1 time: 0.285513 Dec 16 17:57:43.993872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 241/472] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:43 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:44.131321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:44.133113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:44.146112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.146847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.148094 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.148679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.451606 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:44.463138 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8cffc23e-7cc2-4349-b007-6da9218ba04c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1508 microversion: 2.1 time: 0.338975 Dec 16 17:57:44.470327 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 232/473] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:44 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:44.665068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-34b6197b-1476-4b37-b1aa-eb8fb5b8d35e req-7fc552ca-8589-44cc-b70a-05c2ed478d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345afa0a-e4be-42d8-869a-ee8774b777f2", "name": "network-vif-deleted", "tag": "91aec430-6b62-412b-a19f-511a7db58d0b"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:44.667510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:57:44.667510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:57:44.677664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-34b6197b-1476-4b37-b1aa-eb8fb5b8d35e req-7fc552ca-8589-44cc-b70a-05c2ed478d99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.677862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-34b6197b-1476-4b37-b1aa-eb8fb5b8d35e req-7fc552ca-8589-44cc-b70a-05c2ed478d99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.693105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-34b6197b-1476-4b37-b1aa-eb8fb5b8d35e req-7fc552ca-8589-44cc-b70a-05c2ed478d99 service nova] Creating event network-vif-deleted:91aec430-6b62-412b-a19f-511a7db58d0b for instance 345afa0a-e4be-42d8-869a-ee8774b777f2 on hv-cinder-81920 Dec 16 17:57:44.699647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-34b6197b-1476-4b37-b1aa-eb8fb5b8d35e req-7fc552ca-8589-44cc-b70a-05c2ed478d99 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038987 Dec 16 17:57:44.700292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 242/474] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:57:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:57:44.716134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:44.718048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:44.726830 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.729797 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.731363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.735364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.763213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:44.764051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:44.772377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.772828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.783148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:44.784674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:44.848461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-92c248d1-7531-4fa6-b53a-e18ff8d8cf2c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 0.138699 Dec 16 17:57:44.850665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 233/475] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:44 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:44.961758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:44.971306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-89bcf740-cc25-433d-8f66-db10284822eb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.213324 Dec 16 17:57:44.982395 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 243/476] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:44 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:44.995065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:44.996666 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:45.009223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.009685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.010473 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.014128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.032342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:45.040073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:45.053077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.056886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.059345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.060968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.120397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4ad3b36c-670e-4d2f-98a0-fd3c9ce4a0fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.129951 Dec 16 17:57:45.122558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 234/477] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:44 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:45.127388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.128557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.129020 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lazy-loading 'fault' on Instance uuid 345afa0a-e4be-42d8-869a-ee8774b777f2 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:57:45.219951 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f33f9ecdbf4e6ea3581cea3ab2ca16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd9aefb930a48bfaa54182fe6a4a20c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:45.229227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b0eb6f76-7db5-42b6-a646-9a8d53844c50 tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 200 len: 1304 microversion: 2.1 time: 0.222427 Dec 16 17:57:45.230241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 244/478] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:45 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:45.864814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:45.865971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:45.874232 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.874691 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.875497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:45.875918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:45.992027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:45.992925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:46.000881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.001335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.002134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.002567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.154338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:46.163301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a2d97f3b-3aa3-4e03-930b-aebd8fd7bdf1 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.176439 Dec 16 17:57:46.163896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 245/479] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:45 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:46.168433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:46.169357 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:46.175531 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.175997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.176773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.177230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.285459 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-08fc6a4f-e329-4358-a319-7a05018263e5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 0.426982 Dec 16 17:57:46.287621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 235/480] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:45 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:57:46.293087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:46.294172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] [instance: 345afa0a-e4be-42d8-869a-ee8774b777f2] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:46.302789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.303283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.304189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:46.304841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:46.321892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ee1b6950-0b0f-4edd-ac0b-f9c1ddf38ea8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.156698 Dec 16 17:57:46.322529 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 246/481] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:46 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:46.329951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] HTTP exception thrown: Instance 345afa0a-e4be-42d8-869a-ee8774b777f2 could not be found. Dec 16 17:57:46.330578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] Returning 404 to user: Instance 345afa0a-e4be-42d8-869a-ee8774b777f2 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:57:46.331495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-76081b67-987a-48f6-baa0-675806274cdc tempest-VolumesActionsTest-1046855616 tempest-VolumesActionsTest-1046855616-project] 10.222.0.32 "GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2" status: 404 len: 111 microversion: 2.1 time: 0.044215 Dec 16 17:57:46.332083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 236/482] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:46 2021] GET /compute/v2.1/servers/345afa0a-e4be-42d8-869a-ee8774b777f2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:57:47.185570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:47.186304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:47.193804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.194246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.195099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.195547 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.296785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:47.297707 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:47.304847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.305299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.306114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.306517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.347532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:47.355520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-137a2571-2fd5-47c0-9965-b0c6f641d2ba tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.174686 Dec 16 17:57:47.356259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 247/483] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:47 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:47.360781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:47.361965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:47.368630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.369084 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.370161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:47.370452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:47.380760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f2162a44-49eb-4bd3-80e0-d283bd3dc488 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 0.087823 Dec 16 17:57:47.381392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 237/484] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:47 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:47.442566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e28161e8-87df-48fb-8c1e-edb24d27402a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.085119 Dec 16 17:57:47.443323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 248/485] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:47 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:48.373303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:48.373993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:48.380989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.382360 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:48.383234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.384047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:48.393940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:48.398672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:48.401961 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.402664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:48.403682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.404315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:48.539076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:48.548413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0a25ec8b-9096-4b68-b542-4f665552a9a2 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.179314 Dec 16 17:57:48.549008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 238/486] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:48 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:48.553337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:48.554240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:48.560288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.560735 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:48.561507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:48.561941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:58.342748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fb70bb0e-d70c-4b44-bf32-3baf504b3af3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 9.953635 Dec 16 17:57:58.343334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 249/487] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:48 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 9955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:58.348293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:58.348984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:58.356196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:58.356613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:58.358055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:58.358375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:58.365171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-34ea6c01-46a4-400c-ba22-f806a900cfad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 9.814941 Dec 16 17:57:58.366215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 239/488] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:48 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 9817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:57:58.495644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:58.508673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ce7a169c-07f5-44eb-80e1-d6249feb2f3f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.163938 Dec 16 17:57:58.509389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 250/489] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:58 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:59.354499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:59.355645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:59.363353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.363796 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.364623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.365079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.378097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:57:59.379119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:59.387281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.387724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.389076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.389692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.443636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-33f04eb6-bc2a-43ec-a717-19dd5cd02544 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 14 microversion: 2.20 time: 0.093104 Dec 16 17:57:59.444226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 240/490] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:57:59 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:57:59.467049 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a1c657b7-99b7-4d64-93ad-3086b03504ea tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.092340 Dec 16 17:57:59.467704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 251/491] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:57:59 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:57:59.526095 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:57:59.526729 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:57:59.534810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.535262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.536046 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:57:59.536480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:57:59.687664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:57:59.698640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-65859a9d-694f-4085-be0c-f9199ed39c66 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.176414 Dec 16 17:57:59.699348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 241/492] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:57:59 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:00.455995 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:00.457030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:00.464308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:00.464753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:00.465536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:00.466011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:00.479168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:00.480694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:00.487575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:00.488139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:00.488811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:00.489332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.115670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f6bc06b1-3a75-43e5-9b51-208474ebc526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 4.639766 Dec 16 17:58:05.119575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 242/493] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:00 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 4642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:05.121976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:05.122649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:05.131293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.131730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.132578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.133146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.151903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-736b23e6-fed4-4920-a6fc-2b82a25194a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 18305 microversion: 2.20 time: 4.700029 Dec 16 17:58:05.155876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 252/494] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:00 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 18305 bytes in 4702 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:05.159656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6a478ee-2b08-4943-a033-6b5bca0e4d36"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:05.160820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:05.168288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.168743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.169695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.170375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.251894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Invalid volume: volume a6a478ee-2b08-4943-a033-6b5bca0e4d36 is already attached to instances: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 Dec 16 17:58:05.252540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 400 to user: Invalid volume: volume a6a478ee-2b08-4943-a033-6b5bca0e4d36 is already attached to instances: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:58:05.253370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c0f738b5-d347-4fc7-9c11-17a9c2f53599 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099384 Dec 16 17:58:05.253943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 253/495] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:58:05 2021] POST /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 17:58:05.273580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:05.282772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8094f0a9-a844-47a9-afa0-1b65c7e8c14d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.164994 Dec 16 17:58:05.283558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 243/496] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:05 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:05.322478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:05.323291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:05.333523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.333975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.334812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.335263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.415812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'services' on Instance uuid 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:58:05.498100 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-479705fe-99b8-45a2-ad69-bc33929d031b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments/a6a478ee-2b08-4943-a033-6b5bca0e4d36" status: 202 len: 0 microversion: 2.1 time: 0.178773 Dec 16 17:58:05.498959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 254/497] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:58:05 2021] DELETE /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments/a6a478ee-2b08-4943-a033-6b5bca0e4d36 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:05.507661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:05.508647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:05.516652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.516652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.517341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:05.517752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:05.552938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-47df09bc-b3af-4f99-b55c-bc4d1eb52056 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049221 Dec 16 17:58:05.553521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 244/498] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:05 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:06.128569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:06.129678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:06.137885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.138340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.139163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.139569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.163859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:06.164904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:06.172494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.172943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.173739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.174175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.680282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c61bb4d1-3ad1-43c6-9f68-3f0a8da2c8ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 19602 microversion: 2.20 time: 0.519829 Dec 16 17:58:06.681172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 245/499] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:06 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 19602 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:06.687968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:06.688942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:06.697507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-28048b14-4e9c-4188-944a-4e663f08c4cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.572421 Dec 16 17:58:06.698963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 255/500] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:06 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:06.699151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.699815 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.701706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.701706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.705544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:06.706533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:06.713424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.713853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.714740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:06.715163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:06.751246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-60b9903c-e497-4e37-8aaa-f2ffcd8f717d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050928 Dec 16 17:58:06.752058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 256/501] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:06 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:06.855254 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:06.869309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1954fe10-8211-4c29-a045-ea23b6712bd4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.186417 Dec 16 17:58:06.870129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 246/502] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:06 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:07.695847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:07.696962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:07.705316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.705991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.706718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.707134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.709610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:07.710550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:07.718296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.718785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.719583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.720027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.834172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9ada8b23-976f-4a70-b587-d7c6e1f0c681 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 22162 microversion: 2.20 time: 0.144332 Dec 16 17:58:07.834855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 257/503] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:07 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 22162 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:07.839894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:07.841156 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:07.846526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-44223eed-f642-4640-8fec-272bf6fbd271 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.140438 Dec 16 17:58:07.847225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 247/504] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:07 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:07.850941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.850941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.850941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.850941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.883326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d63cfa7d-e3dc-428d-b909-6c499d543ceb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Dec 16 17:58:07.883880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 258/505] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:07 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:07.889601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:07.890313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:07.897560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.898007 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:07.898851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:07.899284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:08.047402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:08.056538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-68e41c0f-fc89-472e-a712-8d7d2408c00b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.171254 Dec 16 17:58:08.057134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 248/506] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:07 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:08.846376 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:08.847455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:08.859102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:08.860089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:08.864579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:08.867168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:08.867339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:08.868122 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:08.868445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:08.868543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:08.870108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:08.870821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:08.997859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-455abab2-ea1f-4ae9-8139-73225f5bedb2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.142635 Dec 16 17:58:08.998528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 249/507] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:08 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:58:09.003980 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:09.004979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:09.012205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:09.012654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:09.013436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:09.013869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:09.022459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d77fc0f3-6e43-4162-9b53-84160fe65103 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 23229 microversion: 2.20 time: 0.180298 Dec 16 17:58:09.023206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 259/508] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:08 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 23229 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:09.051935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d0bdea1c-d526-48b6-9bea-6df79390c43c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051137 Dec 16 17:58:09.051935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 250/509] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:08 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:09.079635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:09.080670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:09.090222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:09.090745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:09.094602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:09.095681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:09.257196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:09.287266 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0452c7f7-4dac-4827-993c-4b437adaf39c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.212837 Dec 16 17:58:09.288222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 260/510] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:09 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:10.013398 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:10.014434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:10.025976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.026440 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.027393 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.027800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.036907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:10.038342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:10.046145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.046590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.047484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.048025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.128126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-60cea280-6669-4003-bd3c-25011635188b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.120902 Dec 16 17:58:10.128791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 251/511] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:10 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:10.136113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:10.137304 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:10.160971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.160971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.160971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.160971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.183902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-660c95ea-659d-485c-9dbb-d96d39541839 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 24258 microversion: 2.20 time: 0.151184 Dec 16 17:58:10.184573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 261/512] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:10 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 24258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:58:10.226298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-922b4aad-344f-4dc6-a46d-c422f7f52b9c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096216 Dec 16 17:58:10.227402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 252/513] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:10 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:10.308954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:10.310375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:10.320201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.321640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.323980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:10.324756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:10.496020 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:10.507067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-86284966-f55c-4a78-94d0-dac4408142ee tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.202535 Dec 16 17:58:10.508239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 262/514] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:10 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:10.624748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-662969567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-503061536", "security_groups": [{"name": "tempest-secgroup-smoke-304277021"}], "networks": [{"uuid": "3fa6e92a-e070-482a-ab38-6f3c9667d238"}], "block_device_mapping_v2": [{"uuid": "6e5167a4-f4f2-48f1-969b-0fbe69a9a0e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:10.771763 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] validate_networks() for [('3fa6e92a-e070-482a-ab38-6f3c9667d238', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:58:11.141914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:11.142872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:11.149866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.150305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.151283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.151856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.242566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:58:11.243130 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:58:11.243485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:58:11.243912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:58:11.244355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:58:11.254782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.255257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.256126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.256558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.275924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-42affa12-19f1-4970-a8cd-7bf30d291732 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.138671 Dec 16 17:58:11.276597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 263/515] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:11 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:11.282662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:58:11.287726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Getting quotas for user 8317cb247b074647a1788f28f986ebc6 and project 30f9c4f0e45341af9bb59fb5a170bba7. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:58:11.295017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:11.296026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:11.311405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.311954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.318727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.319170 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.351983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:58:11.354449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e5167a4-f4f2-48f1-969b-0fbe69a9a0e9',volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:58:11.456077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0802f496-e5de-44e6-9e0b-d545a662c109 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 25280 microversion: 2.20 time: 0.174003 Dec 16 17:58:11.457038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 264/516] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:11 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 25280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:11.462686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:11.464790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:11.478527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.479328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.480353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.481035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.519734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c171fa2c-2793-4445-9c62-3039f22c8c37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061056 Dec 16 17:58:11.520888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 265/517] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:11 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:11.526166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:11.527117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:11.537852 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.539006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.540183 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:11.540843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:11.552293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-057e4c89-c210-4759-8b0f-c42173c82770 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932715 Dec 16 17:58:11.556877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 253/518] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:58:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:58:11.569563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c75cf994-ccdf-45e0-a1cf-42f82dfc0657 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:11.572527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c75cf994-ccdf-45e0-a1cf-42f82dfc0657 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:11.656518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c75cf994-ccdf-45e0-a1cf-42f82dfc0657 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:11.664759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c75cf994-ccdf-45e0-a1cf-42f82dfc0657 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1087 microversion: 2.1 time: 0.101886 Dec 16 17:58:11.675033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 254/519] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:11 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1087 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:11.763515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:11.774969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2897f869-52a4-4acf-a516-6f25498d0140 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.252672 Dec 16 17:58:11.775866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 266/520] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:11 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:12.295235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:12.297261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:12.320488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.321321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.322523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.323252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.481603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a02e0012-a329-46f0-8013-49686317d468 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.197056 Dec 16 17:58:12.483466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 255/521] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:12 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:12.485573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:12.486538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:12.505627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.506209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.507292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.508146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.533735 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:12.535331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:12.565042 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.565505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.566330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.566915 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.613757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dda0193d-0ad3-413c-a74a-217cb387730b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085784 Dec 16 17:58:12.615104 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 256/522] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:12 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:58:12.671281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a60aa6ae-bad5-428e-bfde-28b34a63c57a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 26103 microversion: 2.20 time: 0.203853 Dec 16 17:58:12.673298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 267/523] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:12 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 26103 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:58:12.683023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:12.683880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:12.690787 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.691559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.692925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.693576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.788822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:12.799174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6bb17fbd-0783-4af1-929e-2af3b31d1eeb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1185 microversion: 2.1 time: 0.120646 Dec 16 17:58:12.804573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:12.806965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:12.809899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 257/524] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:12 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:12.815211 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.815620 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:12.816619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:12.817092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.032884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:13.044029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c5a176aa-13cf-4ff9-bcf0-957caed76b98 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.248537 Dec 16 17:58:13.044925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 268/525] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:12 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:13.496950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:13.501331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:13.509156 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.510151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.511378 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.511963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.627421 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:13.628946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:13.641004 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.641648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.643185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.650971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.692273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d155f821-76c0-468b-aac0-237e98b496e1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.201754 Dec 16 17:58:13.693841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 258/526] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:13 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:13.700208 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:13.701497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:13.720271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.722073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.723477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.724138 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.734845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b09d06e8-0348-4494-9467-39f2fc76f78d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112022 Dec 16 17:58:13.735941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 269/527] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:13 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:13.817388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:13.818539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:13.825572 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-de148a8e-9379-467d-8f0f-9f7a9f296c59 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 26987 microversion: 2.20 time: 0.129983 Dec 16 17:58:13.826244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 259/528] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:13 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 26987 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:13.832007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.832674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.833656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:13.834316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:13.957537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:13.983588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-37262a84-8ba6-4b91-9a8e-9fcf2cbdc24a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1203 microversion: 2.1 time: 0.156624 Dec 16 17:58:13.986038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 270/529] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:13 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:14.063469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:14.064617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:14.082651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.083609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.084826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.085488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.295167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:14.305952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-58f81bea-b8d6-42af-9a2e-d5b4841f1d17 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.248695 Dec 16 17:58:14.317681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 260/530] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:14 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:14.706664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:14.707706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:14.715791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.716238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.717363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.728996 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.746917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:14.748828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:14.772356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.772849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.773678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.774131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.844201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e8eab8ed-b17e-4bb3-8231-0360f010271b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.140849 Dec 16 17:58:14.845338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 271/531] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:14 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:14.855455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:14.860384 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:14.868061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.868749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.869698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:14.870283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:14.874417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d085fdd8-2240-45e9-9651-3c4b2102e9a2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131653 Dec 16 17:58:14.878043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 261/532] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:14 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:15.005740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:15.006441 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:15.019284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.019892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.021415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.021957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.267909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:15.271212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-db5fa3df-b7fc-44b9-a9f7-f727fb39ca0d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27107 microversion: 2.20 time: 0.423411 Dec 16 17:58:15.273870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 272/533] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:14 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27107 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:15.284839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d544efda-4404-4bbd-a523-2bc86c933974 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1270 microversion: 2.1 time: 0.282769 Dec 16 17:58:15.290142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 262/534] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:15 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:15.326668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:15.327482 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:15.335227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.335964 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.337444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.338234 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.424032 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-1dbfe32d-b005-4ec6-9a03-28c47fb0bc23 req-6e755dd4-6ea5-4163-b433-0c04a8d50f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:15.426396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:58:15.426396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:58:15.439899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1dbfe32d-b005-4ec6-9a03-28c47fb0bc23 req-6e755dd4-6ea5-4163-b433-0c04a8d50f29 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.452916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1dbfe32d-b005-4ec6-9a03-28c47fb0bc23 req-6e755dd4-6ea5-4163-b433-0c04a8d50f29 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.488779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-1dbfe32d-b005-4ec6-9a03-28c47fb0bc23 req-6e755dd4-6ea5-4163-b433-0c04a8d50f29 service nova] Creating event network-changed:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 17:58:15.495210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-1dbfe32d-b005-4ec6-9a03-28c47fb0bc23 req-6e755dd4-6ea5-4163-b433-0c04a8d50f29 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075631 Dec 16 17:58:15.496999 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 263/535] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:58:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:15.676980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:15.687653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a2e403df-d098-4c25-9847-4bafa1b99581 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.365658 Dec 16 17:58:15.700860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 273/536] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:15 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:15.858332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:15.859475 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:15.873968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.874537 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.875380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.875813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.888968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:15.890025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:15.897058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.897941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.899006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:15.899616 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:15.941708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6db97d69-de91-4d10-8afe-08e19876ebd4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056724 Dec 16 17:58:15.942308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 274/537] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:15 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:58:15.991862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7cc04669-7f66-4144-b023-2bb5b3709e04 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.138453 Dec 16 17:58:15.993330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 264/538] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:15 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:16.286321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:16.287837 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:16.294938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.295726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.296865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.303123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:16.313040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:16.323870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.338179 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.339092 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.343449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.345425 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.432401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a199cb90-720b-4d84-9a9f-6c0e5525246b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27607 microversion: 2.20 time: 0.150837 Dec 16 17:58:16.437876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 275/539] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:16 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:16.542524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:16.550922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3b5271f9-cd04-407d-bb71-017962235fed tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1270 microversion: 2.1 time: 0.251935 Dec 16 17:58:16.551763 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 265/540] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:16 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:16.713006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:16.713281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:16.725315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.727394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.729610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.735809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.953869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:16.954884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:16.966286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:16.977049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.977504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:16.978926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:16.979074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-15b700bf-85f0-4c62-a59d-eace0a08c4bb tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.270915 Dec 16 17:58:16.979654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 276/541] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:16 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:16.988935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.005869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:17.007558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:17.017363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.017959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.019066 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.020073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.025629 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-eb085ad7-df81-4901-bd1d-b35409ec57d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075876 Dec 16 17:58:17.026330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 266/542] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:16 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:58:17.252012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b930c313-0df3-462e-941b-4f2da14b8584 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.250986 Dec 16 17:58:17.253400 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 277/543] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:16 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:58:17.444590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:17.445982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:17.454911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.455346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.456402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.456846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.568815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:17.569466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:17.577101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.578322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.579342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:17.580035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:17.582563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-160a93a4-1590-4706-9d58-83cf65433283 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27732 microversion: 2.20 time: 0.141592 Dec 16 17:58:17.583278 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 267/544] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:17 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27732 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:17.754855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:17.763386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5faa013e-134c-44dd-b597-a969dae2650a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1270 microversion: 2.1 time: 0.198531 Dec 16 17:58:17.765139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 278/545] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:17 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:17.996914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:17.998597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:18.006760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.007597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.008843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.009483 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.038531 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:18.039686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:18.055096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.055096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.055096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.055096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.095926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-69012bdd-a924-425c-ad4f-2c0bb5f55ddc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061462 Dec 16 17:58:18.097516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 279/546] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:18 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:18.197449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:18.206244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6def90ab-3a2e-4f49-a47b-aaf7244d5ea5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.213389 Dec 16 17:58:18.207456 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 268/547] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:17 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:18.265496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:18.266647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:18.273322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.273760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.274548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.275162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.597137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:18.598579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:18.605567 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.606374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:18.607021 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:18.607737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.671582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-454949ea-922b-4e55-9f69-d3d1f1e427f6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 4.408728 Dec 16 17:58:22.673170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9d70b60b-4db6-430a-877e-0e5e844e3228 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27858 microversion: 2.20 time: 4.077687 Dec 16 17:58:22.674730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 280/548] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:18 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 4414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:22.678832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 269/549] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:18 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27858 bytes in 4083 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:22.686844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:22.690985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:22.692622 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:22.693924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:22.709008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.709914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.710601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.711334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.712512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.714108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.714456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.715259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.804978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fbb07483-af4e-418b-aa05-69cac0fc0ff8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122234 Dec 16 17:58:22.807325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 270/550] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:22 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:22.818660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:22.821941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:22.835605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.836670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.837901 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:22.838546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:22.903070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:22.915302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-15e0d3c8-b897-43e9-afa1-6acba69285c9 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1270 microversion: 2.1 time: 0.234238 Dec 16 17:58:22.917408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 281/551] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:22 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:23.070185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:23.079431 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0609ede7-d109-4bee-9ff7-1812dc298f80 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.270120 Dec 16 17:58:23.080043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 271/552] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:22 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:23.685895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:23.686563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:23.687522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:23.687739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:23.695738 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:23.696334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:23.697164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:23.697785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:23.698668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:23.699335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:23.700160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:23.700595 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.005414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1fc90c5d-dfe8-4b35-a00c-193bf2ac75c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.323050 Dec 16 17:58:24.005971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 272/553] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:23 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:24.012260 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:24.013509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:24.021188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.022015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.023177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.023943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.036959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8ca8b497-b463-43a8-beaa-c5e6285e4a46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27859 microversion: 2.20 time: 0.354619 Dec 16 17:58:24.039185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 282/554] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:23 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27859 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:24.048800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:24.050705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:24.059575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.061112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.064770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.065601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.069627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1ba80433-c614-484f-8cdd-eb0c47c0621e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061994 Dec 16 17:58:24.074592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 273/555] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:24 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:24.113219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:24.124046 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:24.158257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.160035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.161589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:24.162030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:24.328207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:24.346567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-da7ae3b5-1a99-4765-8016-2478c76baaf1 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1270 microversion: 2.1 time: 0.305771 Dec 16 17:58:24.367234 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 283/556] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:24 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1270 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:24.379603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:24.391573 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-369181f5-5341-4575-a0be-ae209b9153e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.297180 Dec 16 17:58:24.394658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 274/557] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:24 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:25.021649 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:25.022536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:25.029998 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.030701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.031990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.032646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.051581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:25.052808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:25.066446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.067039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.068613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.069147 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.204580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-98e28b89-a3dd-446a-8c7f-520f45c033d7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.188570 Dec 16 17:58:25.209658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 284/558] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:25 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:25.216987 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:25.218825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:25.231152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.231578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.232607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.233035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.265713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-34cc42bf-1497-4da8-965f-52749bc2832d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054187 Dec 16 17:58:25.266353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 285/559] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:25 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:58:25.364197 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:25.365040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:25.376896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.377412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.378295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.380197 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.581041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:25.589488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ad81fabf-9371-467b-a2d7-03ed096a97c5 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.228897 Dec 16 17:58:25.590078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 286/560] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:25 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:25.604901 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:25.605517 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:25.613038 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.613549 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.614319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:25.614738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:25.772763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:25.781828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a224603c-e8b1-491a-8d09-aa9301b33230 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.180633 Dec 16 17:58:25.782461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 287/561] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:25 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:25.787042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-904140271", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d5430d91-7e76-4358-9d35-08edfd4e96f5"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:25.850300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] validate_networks() for [('d5430d91-7e76-4358-9d35-08edfd4e96f5', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:58:26.286162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:58:26.287826 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:58:26.288378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:58:26.288857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:58:26.289334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:58:26.300129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:26.300686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:26.301580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:26.302126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:26.322496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:58:26.327252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Getting quotas for user e85da5cbc170449cb9f74d845845bc35 and project 041391a20fed40f39c4d822b2a7727a2. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:58:26.338604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:58:26.341711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:58:26.405744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fb772015-1595-4d3c-8d87-7e46ce7c0469 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621477 Dec 16 17:58:26.407794 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 288/562] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:58:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:58:26.417187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:26.418372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:26.425570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:26.426051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:26.427147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:26.427374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.656963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a9b660d5-110d-472d-8cc8-fd3b92016877 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 27985 microversion: 2.20 time: 3.610534 Dec 16 17:58:28.657710 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 275/563] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:25 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 27985 bytes in 3613 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:58:28.663407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:28.664175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:28.675652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.676420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.677435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.678049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.744736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:28.752688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-01a74609-bdf2-4e74-abac-56fbf3bd2153 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1221 microversion: 2.1 time: 0.093708 Dec 16 17:58:28.753443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 276/564] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:28 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:28.757792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:28.758403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:28.765314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.765802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.766923 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.767359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.916042 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:28.925350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3afadfc6-0b0c-4ed1-bfab-6d20fb2bbc89 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.170902 Dec 16 17:58:28.925886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 277/565] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:28 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:28.930221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:28.930861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:28.938366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.939168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:28.940341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:28.941042 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:29.095794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:29.104292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-56605711-2af6-4f58-baea-e79a0f551338 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.177362 Dec 16 17:58:29.104792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 278/566] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:28 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:29.669175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:29.670190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:29.676910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:29.677353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:29.678136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:29.678562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.824224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2ff58a0a-563c-480a-aa05-2eb71b768dbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 5.416669 Dec 16 17:58:31.824853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 289/567] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:26 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 5418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:31.830345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:31.831068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:31.837881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.838355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.839291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.839707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.904192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:31.912886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c341ad6e-95a8-4ab8-af17-156c4a2a9e08 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1269 microversion: 2.1 time: 0.086928 Dec 16 17:58:31.913551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 290/568] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:31 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:31.917744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:31.918336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:31.924415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3811764e-4df6-457e-87fb-80f2a23016c4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28036 microversion: 2.20 time: 2.258798 Dec 16 17:58:31.928753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 279/569] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:29 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28036 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:31.929814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.929947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.930479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:31.930968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.931249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:31.931458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.939148 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.939682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:31.940589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:31.941017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:32.086406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:32.095098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b0305f84-55a0-44c6-872a-3f31dcb1f9e7 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1568 microversion: 2.1 time: 0.168391 Dec 16 17:58:32.095664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 280/570] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:31 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:32.103771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:32.113397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c57bc519-ce3a-4f1b-8ee0-7fd161593029 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.198882 Dec 16 17:58:32.113972 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 291/571] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:31 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:32.848893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:32.849842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:32.856523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:32.857148 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:32.858558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:32.859230 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:32.931330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:32.931973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:32.942606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:32.943088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:32.943865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:32.944600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:33.097452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:33.104596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5d19bc30-b22a-4381-8237-2ed54221ae77 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.177761 Dec 16 17:58:33.105168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 292/572] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:32 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:33.109854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:33.110865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:33.116849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:33.117267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:33.118046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:33.118473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.780523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4435c898-2a9b-460f-9275-f87249d6c17c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 4.939465 Dec 16 17:58:37.781230 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 281/573] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:32 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 4941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:37.786910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:37.787605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:37.795431 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e062d083-4593-431f-9f3e-45593c993945 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28103 microversion: 2.20 time: 4.688998 Dec 16 17:58:37.797355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.797881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 293/574] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:33 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28103 bytes in 4692 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:37.798192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.799359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.799942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.817439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:37.818160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:37.832364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.832818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.833686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.841766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.952400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:37.962107 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e77fe896-2cae-4b60-892e-873683072dd3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1548 microversion: 2.1 time: 0.179441 Dec 16 17:58:37.962723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 282/575] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:37 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:37.967328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:37.967932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:37.974480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.974953 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:37.975743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:37.976176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.005792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:38.013379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0ce994a5-915b-4432-9479-4e9c47f83772 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.214317 Dec 16 17:58:38.014087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 294/576] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:37 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:38.019619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-83748457-e7f9-4c30-bea0-19707612b0fb req-d51b98df-f0ae-4a01-a47c-8f95a18c6835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b72e46-7e3d-4121-b6ee-e181ce273249", "tag": "edf75e4f-a392-4c19-80da-25bb0006ce0b"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:38.020763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:58:38.020763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:58:38.027962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-83748457-e7f9-4c30-bea0-19707612b0fb req-d51b98df-f0ae-4a01-a47c-8f95a18c6835 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.028405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-83748457-e7f9-4c30-bea0-19707612b0fb req-d51b98df-f0ae-4a01-a47c-8f95a18c6835 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.039871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-83748457-e7f9-4c30-bea0-19707612b0fb req-d51b98df-f0ae-4a01-a47c-8f95a18c6835 service nova] Creating event network-changed:edf75e4f-a392-4c19-80da-25bb0006ce0b for instance e1b72e46-7e3d-4121-b6ee-e181ce273249 on hv-cinder-81920 Dec 16 17:58:38.044649 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-83748457-e7f9-4c30-bea0-19707612b0fb req-d51b98df-f0ae-4a01-a47c-8f95a18c6835 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029299 Dec 16 17:58:38.045209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 295/577] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:58:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:38.051819 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:38.052485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:38.059029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.059475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.060270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.060890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.142892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:38.154656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cf1c8a54-b768-4701-8ae8-5df137656b4e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.190812 Dec 16 17:58:38.156040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 283/578] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:37 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:38.165200 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] HTTP exception thrown: Cannot 'detach_volume' instance 71b128b8-90f3-4162-82d5-7b55358c2a7f while it is in vm_state rescued Dec 16 17:58:38.165800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Returning 409 to user: Cannot 'detach_volume' instance 71b128b8-90f3-4162-82d5-7b55358c2a7f while it is in vm_state rescued {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:58:38.166658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-598465a7-d9e8-4457-b181-3de1823eee1f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments/e1125f11-871a-4241-9d86-d19fdf12aab2" status: 409 len: 152 microversion: 2.1 time: 0.120301 Dec 16 17:58:38.167215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 296/579] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:58:38 2021] DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments/e1125f11-871a-4241-9d86-d19fdf12aab2 => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 17:58:38.175747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:38.176286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:38.182610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.183078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.183853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.184285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.269326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-78d20ffd-d265-4e91-ad82-ddbb80f55014 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.097422 Dec 16 17:58:38.270294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 284/580] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:38 2021] POST /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:38.278548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:38.279181 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:38.287703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.288902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.290154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.291077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.778473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:38.787644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f0e8bd1f-131f-4fbe-89bc-f8460f07e52d tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1556 microversion: 2.1 time: 0.513029 Dec 16 17:58:38.788724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 297/581] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:38 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1556 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:38.793288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:38.794329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:38.806705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.807504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.808595 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.809191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.824066 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:38.827426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:38.843227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.843986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.845336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:38.847701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:38.966495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5386d331-5381-4389-9833-3f4a02b1d3bd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.176728 Dec 16 17:58:38.971403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 285/582] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:38 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:38.977416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-276a0863-8af1-4ab5-b564-319d36d9ee76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28103 microversion: 2.20 time: 0.164674 Dec 16 17:58:38.978039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 298/583] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:38 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28103 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:39.032891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:39.033676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.056072 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.056907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.058086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.058749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.175001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:39.176148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.187421 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.188372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.189873 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.191541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.303546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:39.311791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e87211f6-85de-4d17-a9a8-d4b636a9d626 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.284276 Dec 16 17:58:39.312444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 286/584] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:39 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:39.317297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0a5edb6-9140-4ef0-a272-e514a01a712a", "device": "/dev/sdb"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:39.319073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.330731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.331448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.332240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.332635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.383600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:39.391364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f906e84a-ef55-41fa-b948-ac638caa2553 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.221034 Dec 16 17:58:39.392475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 299/585] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:39 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:39.598641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6a6b86b7-04a1-4deb-8fe0-f23bbd5f87ae tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "POST /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284668 Dec 16 17:58:39.604114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 287/586] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:58:39 2021] POST /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:39.805701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:39.806322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.813150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.813615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.814408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.814872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.954777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:39.963268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bc791272-971e-46b8-b74e-23eba118cf91 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1556 microversion: 2.1 time: 0.161381 Dec 16 17:58:39.963926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 300/587] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:39 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:39.979883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:39.980947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.987712 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.988334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.991402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.991487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:39.991588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.991667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:39.996846 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.997285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:39.998026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:39.998452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.092372 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7543c447-a294-4d9d-bff4-e7f4a7366dbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.116516 Dec 16 17:58:40.093039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 288/588] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:39 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:58:40.170807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1cf8ff81-e789-4c30-bd4d-5ecbb3686393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.185091 Dec 16 17:58:40.171461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 301/589] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:39 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:58:40.329867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:40.330548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:40.338293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.338848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.339925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.340387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.409541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:40.410442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:40.421477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.421477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.421477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.421477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.530250 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:40.539690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fcbcf9be-76bf-4e0b-8586-5c61c2615c68 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.214002 Dec 16 17:58:40.540828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 289/590] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:40 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:40.593981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:40.607466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4c0f5597-fba0-4044-90ce-23bddff36fc0 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.202761 Dec 16 17:58:40.608277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 302/591] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:40 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:40.981810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:40.982486 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:40.990643 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.991109 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:40.991909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:40.992342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.103900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:41.104866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:41.111705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.112156 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.113092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.113704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.133672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:41.142217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dd3424aa-8bc9-4016-90d8-4ad4eb57abc5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1556 microversion: 2.1 time: 0.164453 Dec 16 17:58:41.143053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 290/592] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:40 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:41.183541 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:41.184451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:41.190637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.191102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.191887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.192318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.271855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-23315d1a-55da-4052-9187-0b5267b7092a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.092162 Dec 16 17:58:41.274600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 291/593] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:41 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:58:41.277161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8d52f255-9959-49da-8d51-a94ca16fadd4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.176960 Dec 16 17:58:41.277809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 303/594] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:41 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:58:41.557925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:41.558784 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:41.566350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.566768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.567571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.568006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.625274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:41.626145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:41.634155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.634597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.635403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:41.635909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:41.727275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:41.735313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a53ae4e6-5c20-45b8-9800-8d786479e0f6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.181467 Dec 16 17:58:41.735890 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 292/595] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:41 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:41.772972 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:41.780710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4eb829e8-acfe-49cf-b94f-b432dbc2c71d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.159622 Dec 16 17:58:41.781252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 304/596] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:41 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:42.162679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:42.163577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:42.173449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.174222 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.175617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.176336 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.284430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:42.285472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:42.292278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.292720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.293515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.293918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.318958 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:42.327386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-361eb486-57d5-4b89-8acd-fd7bd0ab5da4 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1556 microversion: 2.1 time: 0.171139 Dec 16 17:58:42.327954 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 293/597] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:42 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:42.333160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:42.334071 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:42.340076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.340520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.341615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.342041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.362031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4d0b1f1d-7665-4b82-9809-d89327460409 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.081456 Dec 16 17:58:42.363116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 305/598] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:42 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:42.459386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-666e6bbf-acb0-4717-b2eb-54bf1869f7e9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.129727 Dec 16 17:58:42.460231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 294/599] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:42 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:42.753764 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:42.754548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:42.762098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.762641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.763545 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.763858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.799337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:42.800052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:42.807833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.808876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.810498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:42.811325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:42.940415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:42.947776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7101f919-d901-4444-9ffb-da7800feebf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.199110 Dec 16 17:58:42.948347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 306/600] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:42 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:42.974512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:42.982469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-937a19b7-a230-4d0f-8c71-214e8b46cdd6 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.188445 Dec 16 17:58:42.983387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 295/601] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:42 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:43.345878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:43.346578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:43.356416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.357012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.358101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.358715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.373297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:43.374308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:43.381405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.381858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.382748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.383195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.496141 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:43.504432 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fca36079-689f-4cd2-8421-000611511129 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1556 microversion: 2.1 time: 0.163271 Dec 16 17:58:43.505028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 307/602] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:43 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:43.510318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:43.511599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:43.513962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1730d1b9-25d6-48c4-baa4-fac3d7fd60d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.144118 Dec 16 17:58:43.518382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 296/603] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:43 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:43.518561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.518950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.519744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.520178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.610912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9cd58164-de68-4e76-b4ea-f9c69ac01d6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.104203 Dec 16 17:58:43.612692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 308/604] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:43 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:43.968863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:43.970008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:43.977852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.978495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:43.979497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:43.980126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.001738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:44.002472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.013217 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.013668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.014461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.014917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.163201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:44.170797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6f43951a-166b-4431-9102-b8661a307d53 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.172962 Dec 16 17:58:44.171524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 309/605] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:43 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:44.221014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:44.230348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-84b06ec1-9cfa-454c-86ff-9fb1b05e5453 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.265849 Dec 16 17:58:44.239317 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 297/606] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:43 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:44.524980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:44.525612 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.527056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:44.528625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.532523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.533250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.534082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.534704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.536920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.537364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.538300 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.538768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.646054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a26863d8-fd7c-4db2-b5f0-ba5070564570 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.123103 Dec 16 17:58:44.646733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 298/607] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:44 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:44.652346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:44.653346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.660041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.665836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.679600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.680053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.687064 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:44.696466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-95e317db-e5ad-4370-97e4-d7f557dddbe6 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1562 microversion: 2.1 time: 0.177393 Dec 16 17:58:44.697427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 310/608] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:44 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:44.751684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5dce43c6-346d-446c-958d-bf4d1bf8f4e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.100754 Dec 16 17:58:44.751684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 299/609] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:44 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:44.764728 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:44.765221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.771742 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.772186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.772978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.773410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.853525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lazy-loading 'services' on Instance uuid 71b128b8-90f3-4162-82d5-7b55358c2a7f {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:58:44.927032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e586b418-c6d2-4025-8761-c13af1206811 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments/e1125f11-871a-4241-9d86-d19fdf12aab2" status: 202 len: 0 microversion: 2.1 time: 0.166257 Dec 16 17:58:44.927604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 311/610] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:58:44 2021] DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments/e1125f11-871a-4241-9d86-d19fdf12aab2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:44.936322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:44.937588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:44.945158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.945601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.946450 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:44.947173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:44.978299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-54ddab1b-291e-4b40-868e-f03eabe17c8c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Dec 16 17:58:44.978894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 300/611] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:44 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:45.189331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:45.189945 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:45.196443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.196894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.197680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.198123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.246777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:45.247383 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:45.254318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.254791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.255576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.256004 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.338437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:45.346866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e1a1aa25-1c1d-4139-9c06-5d1e53d69385 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.161962 Dec 16 17:58:45.347565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 312/612] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:45 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:45.394759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:45.402454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0afac61a-274f-40c2-b95a-6cf0bb87511b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.159370 Dec 16 17:58:45.403102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 301/613] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:45 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:45.658279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:45.659305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:45.665566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.666035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.666897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.667370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.737267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-94b39f5b-aab6-4467-81ca-a822f4f1dc99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.082776 Dec 16 17:58:45.737825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 313/614] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:45 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:45.770242 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:45.771204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:45.777655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.778094 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.778902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:45.779325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:45.990367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:45.991358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:46.000916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.001455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.002256 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.002724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.019134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-edcdedb5-b4de-4cfc-a474-781f995459cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.252679 Dec 16 17:58:46.020074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 302/615] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:45 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:46.036730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c9629a51-92be-4494-913f-8833720d670c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050667 Dec 16 17:58:46.037504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 314/616] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:45 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:46.369058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:46.370389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:46.382493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.383331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.384709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.385488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.419714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:46.420445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:46.428777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.429293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.430386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.430947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.537414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:46.548978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e94fc3e6-71c0-4f07-b0c9-cb5af5c905c9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.187227 Dec 16 17:58:46.550215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 303/617] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:46 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:46.580381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:46.587781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e4e35b04-6f30-43b3-8f1e-60b0d04b7695 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.171804 Dec 16 17:58:46.588754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 315/618] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:46 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:46.754997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:46.755942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:46.773120 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.773955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.774718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:46.775323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:46.862247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-27bd42e9-32f7-4db5-bc85-651b34cf66d5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.117155 Dec 16 17:58:46.863080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 304/619] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:46 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:47.031588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:47.032965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:47.039725 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.040301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.041112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.041544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.049394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:47.050995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:47.061244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.061244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.061904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.062408 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.098297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ceb00798-2df0-4b8a-a06c-876482d8411c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054006 Dec 16 17:58:47.098987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 305/620] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:47 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:47.116480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-faa605be-54b8-44b6-be17-c861110a4bbd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.088050 Dec 16 17:58:47.117698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 316/621] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:47 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:47.573707 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:47.574362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:47.581363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.581800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.582748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.583409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.607311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:47.608181 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:47.615690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.616137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.616921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.617352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.726798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:47.734698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ff59990c-f29c-42e6-befa-c5d1428299ba tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.164906 Dec 16 17:58:47.736093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 306/622] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:47 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:47.756434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:47.763703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fd9896b2-b4ce-4716-a278-7a80f5204fbb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.161574 Dec 16 17:58:47.764301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 317/623] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:47 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:58:47.877951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:47.880108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:47.887392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.887910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:47.889328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:47.890146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.111494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:48.112485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:48.119243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.119938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.120816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.121261 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.174745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7263202c-fe57-4193-adaf-f21a1539a921 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067889 Dec 16 17:58:48.182782 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 318/624] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:48 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:48.191550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:48.193448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:48.202864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.203456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.204576 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.205247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.565600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bf5557a9-88b5-4bdb-adb8-d3d2d8a9a7f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.691385 Dec 16 17:58:48.566247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 307/625] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:47 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:48.571376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-952f76dc-3120-48fe-a3fa-fa1e663888de req-cedea92c-9ab7-4ae9-8613-c25b36f910a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b72e46-7e3d-4121-b6ee-e181ce273249", "name": "network-vif-plugged", "status": "completed", "tag": "edf75e4f-a392-4c19-80da-25bb0006ce0b"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:48.572976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:58:48.572976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:58:48.581374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-952f76dc-3120-48fe-a3fa-fa1e663888de req-cedea92c-9ab7-4ae9-8613-c25b36f910a5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.581800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-952f76dc-3120-48fe-a3fa-fa1e663888de req-cedea92c-9ab7-4ae9-8613-c25b36f910a5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.593393 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-952f76dc-3120-48fe-a3fa-fa1e663888de req-cedea92c-9ab7-4ae9-8613-c25b36f910a5 service nova] Creating event network-vif-plugged:edf75e4f-a392-4c19-80da-25bb0006ce0b for instance e1b72e46-7e3d-4121-b6ee-e181ce273249 on hv-cinder-81920 Dec 16 17:58:48.598944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-952f76dc-3120-48fe-a3fa-fa1e663888de req-cedea92c-9ab7-4ae9-8613-c25b36f910a5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031355 Dec 16 17:58:48.599587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 308/626] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:58:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:48.668473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-774f5488-071a-47f4-a504-5ff081f2ac32 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.483317 Dec 16 17:58:48.669113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 319/627] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:48 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:48.752944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:48.753673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:48.760745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.761165 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.761898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.762336 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.782339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:48.783112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:48.790016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.790370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.791215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:48.791642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:48.905411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:48.913117 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-78a4168f-132a-43cf-ab43-e0263f1603c4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.165102 Dec 16 17:58:48.913718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 309/628] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:48 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:48.961221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:48.969310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bfbbc21a-7330-4b1e-a301-ba3298f09e42 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.191617 Dec 16 17:58:48.969835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 320/629] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:48 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:49.188671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:49.189678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:49.197699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.198134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:49.198976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.199399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:49.231845 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bd87e227-0e01-4f73-a264-a86a1e28446c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Dec 16 17:58:49.232315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 310/630] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:49 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:49.577680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:49.578528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:49.585262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.585708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:49.586489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.586959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:49.681985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:49.682898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:49.689516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.689959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:49.690781 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:49.691205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.543898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c24cf69b-42a7-402e-8eec-9c1af6ea7312 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 2.969953 Dec 16 17:58:52.544534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 321/631] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:49 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 2972 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:52.549360 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:52.550043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:52.556031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6b1f63f9-44e7-475b-a5af-e8de8e79cc91 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 2.877644 Dec 16 17:58:52.559876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 311/632] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:49 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 2880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:58:52.560006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.560006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.560006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.560006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.562176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:52.564305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:52.572270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.572967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.573793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.574227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.699623 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:52.707780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-96163d0c-3c37-45c8-9301-cc99a63c2f03 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.161961 Dec 16 17:58:52.708338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 322/633] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:52 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:52.712991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:52.713275 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:52.714235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:52.721621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c012af54-ad59-4b40-97c6-2a07f982ca77 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.163378 Dec 16 17:58:52.722194 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 312/634] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:52 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:52.723052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.723550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.724443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:52.724946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:52.761394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b7d55661-e9ea-4bc3-9ec6-30ae645a623a tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051993 Dec 16 17:58:52.762131 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 323/635] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:52 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:58:53.557171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:53.558158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:53.565995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:53.566461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:53.567286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:53.567615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:58:53.568079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:53.568949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:53.575129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:53.575580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:53.576367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:53.576790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.038543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7e920f7d-e832-4212-9819-8c0651d3fa72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 5.474255 Dec 16 17:58:59.039247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 324/636] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:58:53 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 5476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:58:59.042151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1a31a739-b05f-4df8-a2e1-8e3f4aeb6063 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 5.488607 Dec 16 17:58:59.045996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 313/637] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:58:53 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 5490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:58:59.046147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:59.046147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:59.048304 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:59.049004 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:59.052898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.053352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.054111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.054541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.056916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.057353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.058151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.058584 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.198731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:59.200610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:58:59.207462 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cd593a36-b3c2-43a4-9e2e-97155ab70dee tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.167108 Dec 16 17:58:59.208133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 325/638] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:59 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:59.209292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3b3bcf7c-535f-49d6-9fea-5e7a00231f6d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.164675 Dec 16 17:58:59.209867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 314/639] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:58:59 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:58:59.212942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:58:59.213907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:58:59.220960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.221401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.223346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:58:59.223346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:58:59.252898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d1dd0b47-0e57-4ea3-99a9-990aceeaf942 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043521 Dec 16 17:58:59.253704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 326/640] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:58:59 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:59:00.052218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:00.053269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:00.054159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:00.055226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:00.060177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:00.060697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:00.061308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:00.061441 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:00.061752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:00.061864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:00.062540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:00.062994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.549022 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cea15b49-f7aa-48ea-9918-7aa2f293f35a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 4.498580 Dec 16 17:59:04.550160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 327/641] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:00 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 4500 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:04.555793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:04.556717 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:04.557543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ebad4f1f-1f95-48fe-af55-cb42eb82df98 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 4.509695 Dec 16 17:59:04.559941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 315/642] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:00 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 4511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:04.563525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:04.564091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:04.564204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:04.564537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.565359 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:04.565753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.571513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:04.571950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.572741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:04.573750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.715468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:04.716414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:04.724135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-92a0c691-556f-4c0f-8536-48cf0ec4abef tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.172498 Dec 16 17:59:04.724399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2a1f9b12-e741-4bc1-9b7a-1b9bbcde7c67 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.164439 Dec 16 17:59:04.724719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 328/643] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:04 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:04.724859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 316/644] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:04 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:04.729342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-f137327d-70e2-4f4e-9486-93877c2f99ef req-2842eefe-03b9-4a69-8687-f778d4c2cae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "name": "network-vif-plugged", "status": "completed", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:04.730874 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:04.730874 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:59:04.738105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-f137327d-70e2-4f4e-9486-93877c2f99ef req-2842eefe-03b9-4a69-8687-f778d4c2cae3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:04.738542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-f137327d-70e2-4f4e-9486-93877c2f99ef req-2842eefe-03b9-4a69-8687-f778d4c2cae3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:04.750377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-f137327d-70e2-4f4e-9486-93877c2f99ef req-2842eefe-03b9-4a69-8687-f778d4c2cae3 service nova] Creating event network-vif-plugged:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 17:59:04.755406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-f137327d-70e2-4f4e-9486-93877c2f99ef req-2842eefe-03b9-4a69-8687-f778d4c2cae3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029582 Dec 16 17:59:04.756007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 329/645] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:05.564160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:05.565019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:05.570067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:05.571153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:05.571815 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.572283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.573078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.573513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.579130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.579856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.581114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.581747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.797488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-700684ee-c11c-4c4f-abb4-bf90aaa40ddf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.238535 Dec 16 17:59:05.798341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 317/646] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:05 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:05.803955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:05.804756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:05.806024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ac9fab59-4c4f-4fe5-a1f4-fcdf59fd45b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.240293 Dec 16 17:59:05.807740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 330/647] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:05 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:59:05.812569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:05.812883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.813314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.813458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:05.814139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.814714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.822233 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.823247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.824154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:05.824631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:05.995084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:05.998932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:06.006388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7a5c10c0-15ee-480a-8876-41272f784e37 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1317 microversion: 2.1 time: 0.198436 Dec 16 17:59:06.006699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4aec90ca-eba2-478c-81ea-ce1821c252ad tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.206845 Dec 16 17:59:06.006998 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 331/648] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:05 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:06.007399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 318/649] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:05 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:06.810407 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:06.811311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:06.818055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:06.818494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:06.818741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:06.819318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:06.819429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:06.819745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:06.827681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:06.828185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:06.829006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:06.829698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:11.528421 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d0e19bc3-d7cc-4eef-a393-7f6c6af1f65a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 4.721586 Dec 16 17:59:11.529973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 332/650] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:06 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 4725 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:11.535465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:11.536213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:11.543950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:11.544397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:11.545207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:11.545664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:11.568692 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2c9262b6-08a3-47d5-bc73-6f6a47f2fd90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 4.753734 Dec 16 17:59:11.569353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 319/651] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:06 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 4755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:11.574291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:11.575014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:11.582724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:11.583191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:11.584384 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:11.584384 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:11.694540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:11.702440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2fb10172-d34d-419e-82ec-e0e6db1d6488 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1258 microversion: 2.1 time: 0.170935 Dec 16 17:59:11.703069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 333/652] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:11 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:11.742561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:11.748748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fdc0101f-1e62-47df-a071-d3da6b365408 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1506 microversion: 2.1 time: 0.178158 Dec 16 17:59:11.749989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 320/653] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:11 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:12.542010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:12.543222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:12.550151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.550672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.551539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.552023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.581547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:12.582725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:12.589427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.589874 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.590693 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.591495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.663107 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0f2a6758-a8b3-4754-972a-5b660887a14e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.126105 Dec 16 17:59:12.663999 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 334/654] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:12 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:12.705798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-78259b96-b64d-4b77-bdfa-cf1a6e79582a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.128650 Dec 16 17:59:12.706406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 321/655] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:12 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:12.721252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:12.722014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:12.729506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.729942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.730762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.731182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.891842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:12.899934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f9ef84fc-492e-4d7a-8b72-1e759bcba31d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1440 microversion: 2.1 time: 0.182781 Dec 16 17:59:12.900510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 335/656] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:12 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:12.917467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:12.918135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:12.925375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.925818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:12.926598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:12.927065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:13.088700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:13.097884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-027acdcd-35a9-4d1e-9815-23bde10b5b9c tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1440 microversion: 2.1 time: 0.184367 Dec 16 17:59:13.098468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 322/657] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:12 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1440 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:13.675952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:13.676955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:13.683182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:13.683627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:13.684418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:13.684940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:13.719446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:13.720675 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:13.729048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:13.729501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:13.730317 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:13.730792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:13.762258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-69cec51d-bc61-4688-b86b-49289cbc00e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.090497 Dec 16 17:59:13.763001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 336/658] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:13 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:13.818257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-274f5638-580d-4ee2-bb8f-7e1f416aaa82 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.103059 Dec 16 17:59:13.818960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 323/659] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:13 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:14.184514 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "411b1d5c-7b58-4cc8-9271-52e8d1289a35"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:14.185691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:14.193453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.193875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.195263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.195672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.245291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:14.245860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:14.253785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.254237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.255075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.255510 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.289224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:14.392437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8b75a033-9a31-46ad-94bd-90d61533b9ca tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "DELETE /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 204 len: 0 microversion: 2.1 time: 0.151191 Dec 16 17:59:14.393621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 324/660] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:14 2021] DELETE /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:14.409281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:14.409987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:14.416770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.417550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.418352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.418986 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.542999 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f14dcad2-7ff5-4edd-88d3-939101c6ab94 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "POST /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362396 Dec 16 17:59:14.543949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 337/661] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:59:14 2021] POST /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:14.595442 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:14.604446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0fd531da-909f-48fa-bae7-c6f9b2adeea0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1509 microversion: 2.1 time: 0.200258 Dec 16 17:59:14.616712 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 325/662] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:14 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:14.774267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:14.775372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:14.782545 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.783016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.783807 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.784230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.830822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:14.831741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:14.838514 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.839008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.839806 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:14.840227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:14.928946 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ab7da130-a70a-4816-883c-457946346ad9 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.102521 Dec 16 17:59:14.930096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 326/663] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:14 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:14.940082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9fa5e0c7-8c43-4804-a58c-637b5ec1ba18 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.169880 Dec 16 17:59:14.940723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 338/664] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:14 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:15.233290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-714d8490-87b9-43fc-ba50-16cf7858f51c req-b630b6e8-9f59-4a75-8fe7-d9e16d1e37d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:15.235650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:15.235650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:15.244017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-714d8490-87b9-43fc-ba50-16cf7858f51c req-b630b6e8-9f59-4a75-8fe7-d9e16d1e37d6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.244749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-714d8490-87b9-43fc-ba50-16cf7858f51c req-b630b6e8-9f59-4a75-8fe7-d9e16d1e37d6 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.260883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-714d8490-87b9-43fc-ba50-16cf7858f51c req-b630b6e8-9f59-4a75-8fe7-d9e16d1e37d6 service nova] Creating event network-changed:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 17:59:15.268797 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-714d8490-87b9-43fc-ba50-16cf7858f51c req-b630b6e8-9f59-4a75-8fe7-d9e16d1e37d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040943 Dec 16 17:59:15.269411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 327/665] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:15.629641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:15.631749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:15.647473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.647750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.649463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.650707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.924535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:15.932662 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-dea33b4f-6318-4990-a673-78df415999c5 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1509 microversion: 2.1 time: 0.311826 Dec 16 17:59:15.933227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 339/666] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:15 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:15.943169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:15.944488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:15.952766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:15.953693 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:15.957654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.958328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.959203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.959975 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.978229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.978580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:15.979422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:15.979856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:16.086527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-523ce70e-b0b2-4b93-996a-2ec64d92f782 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.147964 Dec 16 17:59:16.087533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 328/667] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:15 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:16.106996 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7ff6f01c-f25b-4361-adcf-8f831d3b0504 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.157527 Dec 16 17:59:16.107757 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 340/668] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:15 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:16.889866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:16.890508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:16.897884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:16.898362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:16.899386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:16.899983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:16.950068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:16.951354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:16.960541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:16.960977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:16.961774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:16.962252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:17.033067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lazy-loading 'services' on Instance uuid 536e020a-872b-41cf-989e-192d42b2a8fb {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:59:17.124588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:17.132981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-19867426-227f-466e-9305-3611d244c684 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1509 microversion: 2.1 time: 0.187036 Dec 16 17:59:17.139188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 341/669] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:16 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:17.146895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:17.148630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:17.156324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:17.156777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:17.157808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:17.158242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:17.178517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9c1dda97-f9af-47a1-90b3-549bc4c0d0d1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "DELETE /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb/os-volume_attachments/e0a5edb6-9140-4ef0-a272-e514a01a712a" status: 202 len: 0 microversion: 2.1 time: 0.292427 Dec 16 17:59:17.179310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 329/670] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:59:16 2021] DELETE /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb/os-volume_attachments/e0a5edb6-9140-4ef0-a272-e514a01a712a => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:17.192044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:17.193187 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:17.201081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:17.203078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:17.204161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:17.206014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:17.255878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fc81020f-d0b7-41ab-abad-6070bbc9f538 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.120081 Dec 16 17:59:17.256575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 342/671] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:17 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:17.311224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-efe07892-4bf6-46ec-9012-d567ff58c42c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.126816 Dec 16 17:59:17.312383 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 330/672] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:17 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:18.157670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:18.158385 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:18.165831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.166284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.167316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.167770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.171562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-4b548527-2c35-4923-b826-d1ac31dc4a72 req-bebda818-8a79-4027-840a-b48cb3540dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5e995c-4d16-4e48-ae00-73880432cf3c", "name": "network-vif-deleted", "tag": "201a0fb1-09f4-4092-a321-78e56c800347"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:18.176356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:18.176356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:18.189579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-4b548527-2c35-4923-b826-d1ac31dc4a72 req-bebda818-8a79-4027-840a-b48cb3540dfa service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.189928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-4b548527-2c35-4923-b826-d1ac31dc4a72 req-bebda818-8a79-4027-840a-b48cb3540dfa service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.205484 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-4b548527-2c35-4923-b826-d1ac31dc4a72 req-bebda818-8a79-4027-840a-b48cb3540dfa service nova] Creating event network-vif-deleted:201a0fb1-09f4-4092-a321-78e56c800347 for instance da5e995c-4d16-4e48-ae00-73880432cf3c on hv-cinder-81920 Dec 16 17:59:18.210989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-4b548527-2c35-4923-b826-d1ac31dc4a72 req-bebda818-8a79-4027-840a-b48cb3540dfa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044795 Dec 16 17:59:18.211609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 331/673] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:18.248976 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:18.269373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:18.270367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-20cb2705-98b5-405c-a876-c8f2da652d6e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 200 len: 1467 microversion: 2.1 time: 0.105164 Dec 16 17:59:18.270542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:18.271367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 343/674] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:18 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 1467 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:18.289549 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.290215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.291697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.292143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.323715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:18.324637 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:18.331799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.332243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.333027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:18.333450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:18.382942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f4224eb0-073c-42ec-8b73-3f6ae53c8cf3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.118199 Dec 16 17:59:18.383629 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 332/675] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:18 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:18.415442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a2039ba8-3c88-45f4-a7b4-5818f226d3f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.094854 Dec 16 17:59:18.419931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 344/676] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:18 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:19.288222 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:19.288895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: da5e995c-4d16-4e48-ae00-73880432cf3c] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:19.297709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.298219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.299122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.299553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.314588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] HTTP exception thrown: Instance da5e995c-4d16-4e48-ae00-73880432cf3c could not be found. Dec 16 17:59:19.315237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Returning 404 to user: Instance da5e995c-4d16-4e48-ae00-73880432cf3c could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:19.316065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2e06e948-7581-4c1b-b8a0-7bb0f2158362 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c" status: 404 len: 111 microversion: 2.1 time: 0.032172 Dec 16 17:59:19.316850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 333/677] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:19 2021] GET /compute/v2.1/servers/da5e995c-4d16-4e48-ae00-73880432cf3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:19.325728 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:19.326484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:19.334497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.334981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.335799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.336226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.363411 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:19.394972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:19.395944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:19.403930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.407842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.408931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.409415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.452923 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a31f6c4b-a7f1-4121-bbad-f92a448b6460 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 204 len: 0 microversion: 2.1 time: 0.130970 Dec 16 17:59:19.453565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 345/678] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:19 2021] DELETE /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:19.459388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:19.460397 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:19.466712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.467161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.467942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.468367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.502510 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f1b5fa0c-760c-4930-b239-37134cdfaf17 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.111405 Dec 16 17:59:19.503158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 334/679] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:19 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:19.507967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:19.508676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:19.515972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.516412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.517557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:19.518007 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:19.547086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e0740875-f781-4851-b839-51e937d42556 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.092004 Dec 16 17:59:19.551613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 346/680] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:19 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:19.658195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:19.666957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-68b09c56-d758-4a8d-8f35-cf6b7a20ecf3 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.162536 Dec 16 17:59:19.667543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 335/681] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:19 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:20.515450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:20.516483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:20.524394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.524840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.525688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.526119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.561154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:20.561995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:20.568759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.569210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.570004 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.570429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.602070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9af3cb26-7e86-4484-8e29-072bdd43c095 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28622 microversion: 2.1 time: 0.090453 Dec 16 17:59:20.602726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 347/682] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:20 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:20.653755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-11d87b89-98be-4cfe-9fa2-30526116e767 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.096343 Dec 16 17:59:20.654692 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 336/683] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:20 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:20.685800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:20.686497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:20.693906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.694350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.695172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:20.695603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:20.846885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:20.855090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-065f2cd9-7967-40b4-be17-64324606eb6c tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.173383 Dec 16 17:59:20.855681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 348/684] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:20 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:21.615989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:21.616962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:21.624213 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.624662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:21.625450 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.625911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:21.670888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:21.672385 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:21.679815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.680253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:21.681030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.681463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:21.724563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1387d524-3f11-4283-833b-a6d7c40a4b6f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 28822 microversion: 2.1 time: 0.113772 Dec 16 17:59:21.725667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 337/685] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:21 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 28822 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:21.776210 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-afaed5d5-f95a-4045-8983-fdfb89828847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.110849 Dec 16 17:59:21.777050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 349/686] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:21 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:21.873032 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:21.873866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:21.881421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.881876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:21.882665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:21.883135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.031766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:22.041314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9d6b1d8a-877e-4f3e-8e14-3595b077e71e tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.172347 Dec 16 17:59:22.043011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 338/687] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:21 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:22.247605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:22.248173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:22.255455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.255893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.256754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.257183 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.345542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'services' on Instance uuid e1b72e46-7e3d-4121-b6ee-e181ce273249 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:59:22.428268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-31d393d9-b9fd-4f27-ac7a-cc20e19c5237 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments/411b1d5c-7b58-4cc8-9271-52e8d1289a35" status: 202 len: 0 microversion: 2.1 time: 0.184469 Dec 16 17:59:22.428895 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 350/688] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 17:59:22 2021] DELETE /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments/411b1d5c-7b58-4cc8-9271-52e8d1289a35 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:22.439175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:22.440465 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:22.447984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.448412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.449260 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.449646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.495852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3f0a47f2-1aea-403a-b8a7-ab7f6fa4c98c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062066 Dec 16 17:59:22.496653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 339/689] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:59:22 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:22.738419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:22.739549 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:22.747027 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.747475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.748278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.748739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.789525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:22.790436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:22.797427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.797870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.798650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:22.799108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:22.859827 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-32bd5861-4a6a-45b0-888f-717c4a32d327 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 29599 microversion: 2.1 time: 0.125948 Dec 16 17:59:22.860487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 351/690] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:22 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 29599 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:22.938262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-966cc62d-f510-4463-b042-ce5e3f2f3dbe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.152590 Dec 16 17:59:22.938930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 340/691] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:22 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:23.062024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:23.062605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.070052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.070490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.071300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.071712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.214950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:23.223201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-46cdba29-391d-4af4-a592-7483b837c40b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.166098 Dec 16 17:59:23.224209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 352/692] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:23 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:23.508731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:23.509773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.517243 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.517681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.518453 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.518920 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.553621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-aa7cdf9d-6bd2-4312-a904-3e81196b2b2d tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048927 Dec 16 17:59:23.554396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 341/693] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:59:23 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:23.602533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:23.603370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.613931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.614697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.615984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.616859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.648663 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:23.747473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b1ccd3ff-2d61-411a-91c8-46fa2ad03564 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "DELETE /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 204 len: 0 microversion: 2.1 time: 0.150830 Dec 16 17:59:23.750809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 353/694] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:23 2021] DELETE /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:23.757138 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:23.757793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.766445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.767052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.768078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.768609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.872888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:23.873808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.882997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.883592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.884518 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.885051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.917834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:23.925884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cc0159f3-3ae0-4185-a79e-ec63e0ef4f2a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1514 microversion: 2.1 time: 0.172752 Dec 16 17:59:23.926477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 342/695] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:23 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:23.951524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:23.952771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:23.962436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.962957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:23.964010 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:23.964440 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.014711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-517d7b2a-006b-4f99-be1b-84bfcd23b730 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 30448 microversion: 2.1 time: 0.146185 Dec 16 17:59:24.015368 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 354/696] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:23 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 30448 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:59:24.086400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7ff8bfe6-3a04-4b31-8e56-ef76afd66844 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28220 microversion: 2.20 time: 0.138815 Dec 16 17:59:24.087522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 343/697] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:23 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28220 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:59:24.241802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:24.242491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:24.252189 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.252898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.254094 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.254537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.569118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:24.570350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:24.579585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.579585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.580414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.581040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.620628 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2922d9a9-1ab5-49c7-9dc2-198abb16bc98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057695 Dec 16 17:59:24.621258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 344/698] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 17:59:24 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 17:59:24.660899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:24.674935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3f0e6a75-f2ae-498b-8ff7-6840a623d4b0 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.431401 Dec 16 17:59:24.674935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 355/699] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:24 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:24.945014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:24.945640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:24.952705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.953134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:24.954412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:24.954412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.026743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:25.028425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:25.035886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.036415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.037849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.038290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.103807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:25.113146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f40dc6ed-7f26-4482-8634-ab8390c0e8bc tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1514 microversion: 2.1 time: 0.172680 Dec 16 17:59:25.114061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 345/700] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:24 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:25.119016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:25.120135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:25.126521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.126936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.127775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.128189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.141734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-94b12492-1624-40fd-b75f-ea7430ce1e72 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 31186 microversion: 2.1 time: 0.118445 Dec 16 17:59:25.147191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 356/701] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:25 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 31186 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:25.229826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-31b1899b-43ae-4e7b-94e1-b2e3d0dfd491 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28363 microversion: 2.20 time: 0.114371 Dec 16 17:59:25.233981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 346/702] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:25 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28363 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:25.686260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:25.686982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:25.694862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.695316 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.696101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.696550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.830108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:25.831549 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:25.839660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.840135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.841454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.841888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.841994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:25.850711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-89ae12fb-23ac-43a2-941c-e4bb6570d72b tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.167951 Dec 16 17:59:25.851411 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 357/703] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:25 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:25.874049 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:25.963521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8b748c9d-0648-4968-8188-3429a306dba8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 204 len: 0 microversion: 2.1 time: 0.136748 Dec 16 17:59:25.964389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 347/704] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:25 2021] DELETE /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:25.974050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:25.975456 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:25.984225 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.985028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:25.985851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:25.987076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.134248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:26.135270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:26.141788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.142268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.143093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.143524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.149130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:26.157014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-88294b9d-62db-4780-b22d-1a7ae1439ecb tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1512 microversion: 2.1 time: 0.186913 Dec 16 17:59:26.157581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 358/705] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:25 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:26.167639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:26.168751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:26.176145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.176598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.177392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.177827 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.304376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:26.312902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-83af6f43-1c1b-4318-aed9-0a83a02fa0d0 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1514 microversion: 2.1 time: 0.183102 Dec 16 17:59:26.313405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 348/706] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:26 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:26.321009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:26.321956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:26.328716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.329167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.329966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.330398 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.351647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-dcd00e29-bcaa-4157-b05b-37e19c41e66c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 31662 microversion: 2.1 time: 0.189179 Dec 16 17:59:26.352938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 359/707] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:26 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 31662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:26.474607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2ccf36b8-ef72-4326-b78a-79a5178a5fca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28509 microversion: 2.20 time: 0.158437 Dec 16 17:59:26.475608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 349/708] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:26 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:26.869609 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:26.870645 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:26.877658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.878097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:26.878905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:26.879333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.123496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:27.131988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f01a6cf2-0fa7-482a-979d-5325baaad39f tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1522 microversion: 2.1 time: 0.267292 Dec 16 17:59:27.132810 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 360/709] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:26 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:27.175589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:27.176451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:27.183697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.184145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.185023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.185427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.304409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-4e62b177-11fc-49e8-924f-b6588383befc req-6a3c930f-1245-4a65-b747-75fed97c5902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536e020a-872b-41cf-989e-192d42b2a8fb", "name": "network-vif-deleted", "tag": "53b232b2-b611-4e27-ba0c-c56824b7721b"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:27.305991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:27.305991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:59:27.313365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-4e62b177-11fc-49e8-924f-b6588383befc req-6a3c930f-1245-4a65-b747-75fed97c5902 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.313792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-4e62b177-11fc-49e8-924f-b6588383befc req-6a3c930f-1245-4a65-b747-75fed97c5902 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.339694 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-4e62b177-11fc-49e8-924f-b6588383befc req-6a3c930f-1245-4a65-b747-75fed97c5902 service nova] Creating event network-vif-deleted:53b232b2-b611-4e27-ba0c-c56824b7721b for instance 536e020a-872b-41cf-989e-192d42b2a8fb on hv-cinder-81920 Dec 16 17:59:27.345445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-4e62b177-11fc-49e8-924f-b6588383befc req-6a3c930f-1245-4a65-b747-75fed97c5902 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044645 Dec 16 17:59:27.346111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 361/710] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:59:27.362933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:27.363407 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:27.364107 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:27.371127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.371712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.372695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.373291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.374185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0d7e2752-17f4-45ba-8c96-9f511f297276 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1512 microversion: 2.1 time: 0.202732 Dec 16 17:59:27.375163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 350/711] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:27 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:27.381673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:27.382902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:27.389596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.390236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.391211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.391859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.458015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:27.467229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-dd373cb4-c59f-4f3d-99a8-d417f3b67753 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 200 len: 1304 microversion: 2.1 time: 0.107658 Dec 16 17:59:27.468242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 362/712] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:27 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:27.486287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:27.487294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:27.493502 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.493946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.494816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:27.495252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:27.689566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-99af5f7f-f4fa-4fca-8166-023b48efc33a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28509 microversion: 2.20 time: 0.206841 Dec 16 17:59:27.690231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 363/713] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:27 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:27.723434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a4058b38-04f8-4d34-bc27-b9e2f2d69c4c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 32190 microversion: 2.1 time: 0.346588 Dec 16 17:59:27.724115 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 351/714] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:27 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 32190 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:28.149611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:28.150707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:28.157604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.158023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.158835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.159258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.237954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa51036d32ea408eb61e6c67985b695f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de691ea87f0e4a4f947a9362feda9aaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:28.245914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f7c1f8a6-a8ed-4e61-81be-5358b35e0d16 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 200 len: 1480 microversion: 2.1 time: 0.100358 Dec 16 17:59:28.250145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 364/715] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:28 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 1480 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:28.393897 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:28.394905 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:28.402530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.403005 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.403810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.404220 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.484644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:28.485267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: 536e020a-872b-41cf-989e-192d42b2a8fb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:28.492047 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.492500 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.493289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.493928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.509171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] HTTP exception thrown: Instance 536e020a-872b-41cf-989e-192d42b2a8fb could not be found. Dec 16 17:59:28.509919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Returning 404 to user: Instance 536e020a-872b-41cf-989e-192d42b2a8fb could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:28.510854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d139131f-88c0-42f8-a606-6942e740daf1 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb" status: 404 len: 111 microversion: 2.1 time: 0.029937 Dec 16 17:59:28.511481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 365/716] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:28 2021] GET /compute/v2.1/servers/536e020a-872b-41cf-989e-192d42b2a8fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 17:59:28.551128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:28.569143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6b6a9290-f6cf-488c-a987-5091a1957cf1 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1512 microversion: 2.1 time: 0.179435 Dec 16 17:59:28.569949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 352/717] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:28 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:28.701449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:28.702381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:28.708767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.709216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.709994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.710424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.736048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:28.736999 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:28.743977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.744332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.745144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:28.745558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:28.824997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5f4cb03f-0a52-4764-9eb9-8edc457dadea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28650 microversion: 2.20 time: 0.127034 Dec 16 17:59:28.825647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 366/718] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:28 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28650 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:28.869479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ddc92bfd-5d71-4e9a-b346-c5d619ac63b1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 32805 microversion: 2.1 time: 0.137185 Dec 16 17:59:28.870452 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 353/719] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:28 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 32805 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:29.264330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:29.265085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] [instance: 71b128b8-90f3-4162-82d5-7b55358c2a7f] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:29.276754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.276754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.277519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.277948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.293170 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] HTTP exception thrown: Instance 71b128b8-90f3-4162-82d5-7b55358c2a7f could not be found. Dec 16 17:59:29.293829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] Returning 404 to user: Instance 71b128b8-90f3-4162-82d5-7b55358c2a7f could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:29.294650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f9f822a6-a483-4dd9-b254-8d4b5d7522a8 tempest-ServerRescueNegativeTestJSON-1013762256 tempest-ServerRescueNegativeTestJSON-1013762256-project] 10.222.0.32 "GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f" status: 404 len: 111 microversion: 2.1 time: 0.034579 Dec 16 17:59:29.295720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 367/720] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:29 2021] GET /compute/v2.1/servers/71b128b8-90f3-4162-82d5-7b55358c2a7f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:29.363290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b128b8-90f3-4162-82d5-7b55358c2a7f", "name": "network-vif-deleted", "tag": "290d5ebd-1bac-4c76-8c83-0bdc5ba08385"}, {"server_uuid": "e1b72e46-7e3d-4121-b6ee-e181ce273249", "name": "network-vif-deleted", "tag": "edf75e4f-a392-4c19-80da-25bb0006ce0b"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:29.364921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:29.364921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:29.382871 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.384195 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.396683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] Creating event network-vif-deleted:290d5ebd-1bac-4c76-8c83-0bdc5ba08385 for instance 71b128b8-90f3-4162-82d5-7b55358c2a7f on hv-cinder-81920 Dec 16 17:59:29.397335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] Creating event network-vif-deleted:edf75e4f-a392-4c19-80da-25bb0006ce0b for instance e1b72e46-7e3d-4121-b6ee-e181ce273249 on hv-cinder-81920 Dec 16 17:59:29.404007 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-16398dab-bc6c-4c26-aafd-e8232b189daf req-6a437ffa-e0a0-4047-94f0-a6d96d2e7b9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045794 Dec 16 17:59:29.404924 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 354/721] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:29.587085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:29.587702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:29.594278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.594998 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.595959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.596542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.667322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:29.676915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a55eda5d-a76d-4776-8bd4-b486a9bb4fbc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1470 microversion: 2.1 time: 0.094119 Dec 16 17:59:29.677541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 368/722] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:29 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1470 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:29.838746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:29.839717 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:29.847127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.847575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.848366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.848795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.881416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:29.882327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:29.889472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.889926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:29.890713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:29.891126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:35.492074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-14e20aba-6946-4297-ba03-2e221d9b72ae tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 37801 microversion: 2.1 time: 5.614007 Dec 16 17:59:35.492959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 369/723] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:29 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 37801 bytes in 5616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:59:35.498646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:35.499444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:35.507175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:35.507705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:35.508490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:35.508914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:35.525150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e728857a-82f1-4e0e-a7fd-99a97f8090ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 5.691098 Dec 16 17:59:35.525952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 355/724] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:29 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 5693 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:35.540990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:35.541591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:35.542117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'fault' on Instance uuid e1b72e46-7e3d-4121-b6ee-e181ce273249 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:59:35.584057 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:35.592835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d4ddc1dd-65e2-4ae4-b6d3-5d66ccb3984e tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 200 len: 1307 microversion: 2.1 time: 0.098414 Dec 16 17:59:35.602389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 370/725] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:35 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:35.682538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4f47a4b6-1c76-48bb-854d-2cad0ba65bcf tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Action: 'create', calling method: .version_select at 0x7fca1c092700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-53755554", "metadata": {"Type": "work"}}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:35.684028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4f47a4b6-1c76-48bb-854d-2cad0ba65bcf tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.684819 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4f47a4b6-1c76-48bb-854d-2cad0ba65bcf tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157696 Dec 16 17:59:35.685950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 356/726] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Dec 16 17:59:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 17:59:35.695758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0374fe90-45b5-4574-865f-4e75a9fba8da tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Action: 'create', calling method: .version_select at 0x7fca1c2a85e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-788177189", "metadata": {"Type": "work"}}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:35.697196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0374fe90-45b5-4574-865f-4e75a9fba8da tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.697991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0374fe90-45b5-4574-865f-4e75a9fba8da tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006592 Dec 16 17:59:35.698520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 371/727] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Dec 16 17:59:35 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 16 17:59:35.710584 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-70726a41-0eac-4fb0-b291-985326022b38 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Action: 'create', calling method: .version_select at 0x7fca1c266ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-993898539", "metadata": {"Type": "work"}}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:35.711969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-70726a41-0eac-4fb0-b291-985326022b38 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.712771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-70726a41-0eac-4fb0-b291-985326022b38 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008142 Dec 16 17:59:35.713287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 357/728] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Dec 16 17:59:35 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 17:59:35.722337 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-30158f5e-91e0-40b2-84a2-bfba99aff885 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Calling method '.version_select at 0x7fca1c167700>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:35.754166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-30158f5e-91e0-40b2-84a2-bfba99aff885 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] HTTP exception thrown: Volume tempest-invalid-1983904595 could not be found. Dec 16 17:59:35.754795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-30158f5e-91e0-40b2-84a2-bfba99aff885 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 404 to user: Volume tempest-invalid-1983904595 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.755634 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-30158f5e-91e0-40b2-84a2-bfba99aff885 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1983904595" status: 404 len: 99 microversion: 2.1 time: 0.037339 Dec 16 17:59:35.756185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 372/729] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Dec 16 17:59:35 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1983904595 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 16 17:59:35.765335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e8e0431e-d940-45c5-96cd-7af8ce125ec3 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003642 Dec 16 17:59:35.765865 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 358/730] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Dec 16 17:59:35 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 17:59:35.774277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0baa71de-3ded-41c8-a619-8de51f1575ef tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003766 Dec 16 17:59:35.774974 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 373/731] 10.222.0.32 () {58 vars in 1136 bytes} [Thu Dec 16 17:59:35 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 17:59:35.783313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-127ed8e3-1473-490f-893a-e8431272cd0d tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Calling method '.version_select at 0x7fca1c1a9a60>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:35.812948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-127ed8e3-1473-490f-893a-e8431272cd0d tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] HTTP exception thrown: Volume e50f7f90-1ebd-43f4-bbd2-919e78176fba could not be found. Dec 16 17:59:35.813532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-127ed8e3-1473-490f-893a-e8431272cd0d tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 404 to user: Volume e50f7f90-1ebd-43f4-bbd2-919e78176fba could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.814377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-127ed8e3-1473-490f-893a-e8431272cd0d tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/e50f7f90-1ebd-43f4-bbd2-919e78176fba" status: 404 len: 109 microversion: 2.1 time: 0.034443 Dec 16 17:59:35.814945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 359/732] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 17:59:35 2021] DELETE /compute/v2.1/os-volumes/e50f7f90-1ebd-43f4-bbd2-919e78176fba => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:35.824716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6b74d0f1-55f0-4768-bf0f-7f5806edb586 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Calling method '.version_select at 0x7fca1c0d8ca0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:35.851507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-6b74d0f1-55f0-4768-bf0f-7f5806edb586 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] HTTP exception thrown: Volume 1fb2e093-0281-48ae-b1fd-a52adc7c18fe could not be found. Dec 16 17:59:35.852092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6b74d0f1-55f0-4768-bf0f-7f5806edb586 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] Returning 404 to user: Volume 1fb2e093-0281-48ae-b1fd-a52adc7c18fe could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:35.852910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6b74d0f1-55f0-4768-bf0f-7f5806edb586 tempest-VolumesNegativeTest-786539664 tempest-VolumesNegativeTest-786539664-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/1fb2e093-0281-48ae-b1fd-a52adc7c18fe" status: 404 len: 109 microversion: 2.1 time: 0.032509 Dec 16 17:59:35.853476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 374/733] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 17:59:35 2021] GET /compute/v2.1/os-volumes/1fb2e093-0281-48ae-b1fd-a52adc7c18fe => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:36.506365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:36.507576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:36.515414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.515858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.516635 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.517055 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.537771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:36.538466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:36.545952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.546408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.547280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.547721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.620120 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-139e0d43-3b7c-44ec-84bd-b4c1fe961b46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.086852 Dec 16 17:59:36.625611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 375/734] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:36 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:59:36.625909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:36.626572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: e1b72e46-7e3d-4121-b6ee-e181ce273249] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:36.634098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.634542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.635430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:36.635862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:36.647807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fb7aeecc-513b-49ca-80e0-f0f14b793892 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 38038 microversion: 2.1 time: 0.146814 Dec 16 17:59:36.653438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Instance e1b72e46-7e3d-4121-b6ee-e181ce273249 could not be found. Dec 16 17:59:36.653438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 404 to user: Instance e1b72e46-7e3d-4121-b6ee-e181ce273249 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:36.653438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c67a535e-6b21-4964-96fe-f1fe192ca732 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249" status: 404 len: 111 microversion: 2.1 time: 0.031270 Dec 16 17:59:36.653941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 376/735] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:36 2021] GET /compute/v2.1/servers/e1b72e46-7e3d-4121-b6ee-e181ce273249 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:36.654258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 360/736] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:36 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 38038 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:59:37.633173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:37.634283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:37.641238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.641673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.642542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.643001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.662751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:37.665706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:37.674313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.674888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.675794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.685027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.723861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3f4a1f3c-125d-4b6c-a2f9-e5c78d880200 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.094716 Dec 16 17:59:37.724527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 377/737] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:37 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:37.744217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc7bb144-4b1b-47b2-946e-ed44b7247b23 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 38038 microversion: 2.1 time: 0.086968 Dec 16 17:59:37.744860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 361/738] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:37 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 38038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 17:59:37.793331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:37.793965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:37.802661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.803118 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.804006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.804429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.831600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:37.915338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3cdfab6d-8be3-45c3-b757-5a2056e3ca98 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 204 len: 0 microversion: 2.1 time: 0.125832 Dec 16 17:59:37.916077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 378/739] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:37 2021] DELETE /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:37.926253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:37.927244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:37.937354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.938051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:37.938774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:37.939286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:38.087166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:38.095353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7a5e1b91-6984-4e87-b320-d01e393574b2 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.174639 Dec 16 17:59:38.095931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 362/740] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:37 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:38.737471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:38.738488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:38.745423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:38.745874 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:38.746783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:38.747241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:38.756507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:38.758056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:38.771022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:38.771491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:38.772291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:38.772709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:39.181721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c0c14f01-8519-4953-955f-2fabda2f5287 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.448713 Dec 16 17:59:39.182375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 379/741] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:38 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:39.187320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:39.188011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:39.195046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:39.195592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:39.196412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:39.196815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:39.202467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-417879b2-3185-4c29-8199-a0ef0fef28fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 200 len: 38167 microversion: 2.1 time: 0.449390 Dec 16 17:59:39.203400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 363/742] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:38 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 38167 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 17:59:39.214030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:39.214633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:39.222776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:39.223392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:39.224223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:39.224706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:39.251536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3639873e-9cd0-4f51-a842-f14b403265e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/ips" status: 200 len: 145 microversion: 2.1 time: 0.041828 Dec 16 17:59:39.252129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 364/743] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 17:59:39 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:39.401863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:39.409591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f6e5e44e-ba2b-42b6-9cc6-167834a41a19 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.226089 Dec 16 17:59:39.410162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 380/744] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:39 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:40.193392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:40.194338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:40.202091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:40.202654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:40.203565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:40.204060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:40.426504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:40.427090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:40.433980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:40.434434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:40.435244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:40.435678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:40.590277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:40.598884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9da54445-969c-4107-829b-aab5de0f6b5b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.175915 Dec 16 17:59:40.599446 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 381/745] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:40 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:41.617117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:41.617838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:41.624871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:41.625328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:41.626159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:41.626586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:41.776642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:41.784918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e75b2d3f-8dbf-45ac-9bb8-580c874e23dc tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.171736 Dec 16 17:59:41.785481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 382/746] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:41 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:42.803285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:42.803937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:42.811103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:42.811542 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:42.812347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:42.812770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:42.962948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:42.974029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b2074144-4bbe-4dd4-944d-2aa91379ddc3 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.175021 Dec 16 17:59:42.974608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 383/747] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:42 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:43.995076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:43.995754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:44.002583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:44.003071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:44.003925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:44.004298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:44.147866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:44.155457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3c0b395b-f93f-4bf1-961a-a873e0851f73 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.166243 Dec 16 17:59:44.156058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 384/748] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:43 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:44.655468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d9b36b91-3d5e-4034-85c6-9eb1329657a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 4.465524 Dec 16 17:59:44.656601 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 365/749] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:40 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 4467 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:45.177230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:45.177991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:45.184681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:45.185132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:45.185922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:45.186358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:45.344404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:45.355398 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e83f9e09-5b53-441a-a638-ca02191ad521 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.182014 Dec 16 17:59:45.355969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 385/750] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:45 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:45.624335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1914814868", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "networks": [{"uuid": "d8330e09-9a25-4fb2-9600-d502f13c3fd4"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:45.677856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:45.683212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:45.684726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] validate_networks() for [('d8330e09-9a25-4fb2-9600-d502f13c3fd4', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 17:59:45.698089 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:45.699388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:45.700643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:45.702318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.085259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 17:59:46.085709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 17:59:46.086665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 17:59:46.087088 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 17:59:46.087494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 17:59:46.099589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:46.100274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.100856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:46.101285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.119563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Getting quotas for project e1d5cb18f27d4ce1a89b1f5698ebcbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 17:59:46.124481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Getting quotas for user b1a1432173174bfd86f945f8ea925934 and project e1d5cb18f27d4ce1a89b1f5698ebcbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 17:59:46.138184 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 17:59:46.140670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 17:59:46.191714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c74fa842-b9b6-4b01-a85f-90c33130bf6a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571329 Dec 16 17:59:46.192388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 366/751] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 17:59:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 17:59:46.203284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9b9486e6-9d1d-42c7-974a-4d25033f8137 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:46.203906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9b9486e6-9d1d-42c7-974a-4d25033f8137 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:46.260884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5e04343a-cf7e-4f4b-9df6-2b06a6f753fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.594553 Dec 16 17:59:46.262030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 386/752] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:45 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:46.271784 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9b9486e6-9d1d-42c7-974a-4d25033f8137 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:46.279360 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9b9486e6-9d1d-42c7-974a-4d25033f8137 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1219 microversion: 2.1 time: 0.080009 Dec 16 17:59:46.279931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 367/753] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:46 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:46.373876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:46.374581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:46.387336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:46.387778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.388579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:46.388992 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.616713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:46.624975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fcdc7e34-6070-4e12-963e-0ec3cf715893 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1513 microversion: 2.1 time: 0.255148 Dec 16 17:59:46.625568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 387/754] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:46 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:46.969621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-3b744462-b643-4502-8486-21b3c3deb926 req-03d9a3a2-c854-49e6-8ed1-68b843f7e63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6", "name": "network-vif-deleted", "tag": "93eaa60f-c9d3-436e-8948-b358e656df71"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:46.972178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:46.972178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:46.982150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3b744462-b643-4502-8486-21b3c3deb926 req-03d9a3a2-c854-49e6-8ed1-68b843f7e63a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:46.982593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3b744462-b643-4502-8486-21b3c3deb926 req-03d9a3a2-c854-49e6-8ed1-68b843f7e63a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:46.995628 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-3b744462-b643-4502-8486-21b3c3deb926 req-03d9a3a2-c854-49e6-8ed1-68b843f7e63a service nova] Creating event network-vif-deleted:93eaa60f-c9d3-436e-8948-b358e656df71 for instance 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 on hv-cinder-81920 Dec 16 17:59:47.001657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-3b744462-b643-4502-8486-21b3c3deb926 req-03d9a3a2-c854-49e6-8ed1-68b843f7e63a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Dec 16 17:59:47.002817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 368/755] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:47.273637 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:47.274587 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:47.282017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.282570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.283784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.284270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.296093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:47.297546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:47.304171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.304615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.305583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.306166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.387076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:47.404634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3e87cac4-dacf-44bf-8543-9ffa732dbc19 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1279 microversion: 2.1 time: 0.112468 Dec 16 17:59:47.410821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 369/756] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:47 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:47.621750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9bd7fd29-9e47-4713-89fe-690f6d6f3c42 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.352552 Dec 16 17:59:47.626821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 388/757] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:47 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:47.644497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:47.645251 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:47.653000 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.653522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.654394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.655096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.693383 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.693892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.694559 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'fault' on Instance uuid 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:59:47.766135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:47.777595 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7883d844-7e1d-4789-8081-cffe5008dcbf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 200 len: 1307 microversion: 2.1 time: 0.139038 Dec 16 17:59:47.778884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 370/758] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:47 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:47.954312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a88c07-f1bc-4a28-ac81-c22ce687dc0e"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:47.955537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:47.968068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.968530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:47.969370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:47.970022 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.260447 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c95b6333-f0d1-41f2-b37b-7961d3360ffd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309777 Dec 16 17:59:48.262179 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 389/759] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:59:47 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:48.427177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:48.428531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:48.435180 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.436004 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.437057 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.437582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.622361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:48.632387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-24077f06-32da-4130-8603-b15a3e2e33f4 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.208610 Dec 16 17:59:48.633058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 371/760] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:48 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:48.636344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:48.637745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:48.647412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.647783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.648572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.648991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.744182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e215aa87-9973-4f72-9034-2a657a07bf84 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.113039 Dec 16 17:59:48.745173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 390/761] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:48 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:48.796608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:48.797377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:48.807862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.808651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.809756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.810610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.834184 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Instance 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 could not be found. Dec 16 17:59:48.834807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 404 to user: Instance 5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:48.835644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b9e9eb39-b881-460e-8c7c-ef158908197b tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6" status: 404 len: 111 microversion: 2.1 time: 0.043193 Dec 16 17:59:48.836212 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 372/762] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:48 2021] GET /compute/v2.1/servers/5f551bc5-1ca6-4b03-b26d-b3ff1c5997f6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:48.849707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:48.850792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:48.860619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.861512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.862727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:48.863225 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:48.895763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:48.997458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2f4b3f37-c771-4a3a-9313-d6c863ef5ad7 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 204 len: 0 microversion: 2.1 time: 0.154482 Dec 16 17:59:48.998567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 391/763] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:48 2021] DELETE /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:49.007480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:49.008098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:49.015210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.015660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.016649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.017074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.017744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-5f32b135-ca58-4e9d-9ac7-a403fbcb594a req-b0c0c43b-1a3b-4919-b202-15ee2edcd8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4563a1d-2838-4e79-b193-2399bae7aec4", "tag": "ab7cf641-deaf-449b-a250-cbfc0164d60c"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:49.019330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:49.019330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:59:49.028654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-5f32b135-ca58-4e9d-9ac7-a403fbcb594a req-b0c0c43b-1a3b-4919-b202-15ee2edcd8af service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.029086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-5f32b135-ca58-4e9d-9ac7-a403fbcb594a req-b0c0c43b-1a3b-4919-b202-15ee2edcd8af service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.040093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-5f32b135-ca58-4e9d-9ac7-a403fbcb594a req-b0c0c43b-1a3b-4919-b202-15ee2edcd8af service nova] Creating event network-changed:ab7cf641-deaf-449b-a250-cbfc0164d60c for instance d4563a1d-2838-4e79-b193-2399bae7aec4 on hv-cinder-81920 Dec 16 17:59:49.047033 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-5f32b135-ca58-4e9d-9ac7-a403fbcb594a req-b0c0c43b-1a3b-4919-b202-15ee2edcd8af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Dec 16 17:59:49.048032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 392/764] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:59:49.170535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:49.183336 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2e14f7e2-43d8-4965-a7c9-e4d0a1140033 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1513 microversion: 2.1 time: 0.179789 Dec 16 17:59:49.183927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 373/765] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:49 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:49.656965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:49.657731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:49.664278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.664719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.665561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.668709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.758736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:49.759843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:49.767966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.768583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.769560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:49.769983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:49.897702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:49.907017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d56d3f28-3ac5-46fc-8ca3-58d2e63f175d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.254542 Dec 16 17:59:49.907774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 393/766] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:49 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:50.201938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:50.202580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:50.202771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c352068f-f307-41c8-9b36-6fb7967ab1ff tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.449094 Dec 16 17:59:50.207736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 374/767] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:49 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:50.209461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:50.209916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:50.210738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:50.211161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:50.365347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:50.373172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7be62bd0-0e46-4a3a-ad8c-316cf19032cf tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1513 microversion: 2.1 time: 0.176342 Dec 16 17:59:50.373751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 394/768] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:50 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:50.924742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:50.925582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:50.933077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:50.933521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:50.934304 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:50.934761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:51.072348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:51.079916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-119c9f8d-b623-4dde-b98b-0987daadd1fb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.159294 Dec 16 17:59:51.080479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 375/769] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:50 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:51.215413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:51.216712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:51.223606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:51.224046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:51.224925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:51.225390 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:51.296836 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b73ead83-34cf-44a1-ba6b-6f6e342f0511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.085026 Dec 16 17:59:51.297523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 395/770] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:51 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:51.389598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:51.390352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:51.401979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:51.402489 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:51.403339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:51.403803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:51.570529 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:51.580671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-92373232-242d-4bfc-bd1c-dd55a382a9ff tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1513 microversion: 2.1 time: 0.194514 Dec 16 17:59:51.581565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 376/771] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:51 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:52.098251 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:52.099409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:52.107552 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.108050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.109465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.110130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.115814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-e4347a34-c5b6-4f0a-9d30-58318cd74dc2 req-892199b4-d091-46a9-b175-74c9674c0b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e", "name": "network-vif-deleted", "tag": "48b73dbf-c1ab-40c9-b3f0-e69075e73c6e"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:52.117449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:52.117449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:52.129681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-e4347a34-c5b6-4f0a-9d30-58318cd74dc2 req-892199b4-d091-46a9-b175-74c9674c0b7c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.130607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-e4347a34-c5b6-4f0a-9d30-58318cd74dc2 req-892199b4-d091-46a9-b175-74c9674c0b7c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.143516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-e4347a34-c5b6-4f0a-9d30-58318cd74dc2 req-892199b4-d091-46a9-b175-74c9674c0b7c service nova] Creating event network-vif-deleted:48b73dbf-c1ab-40c9-b3f0-e69075e73c6e for instance 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e on hv-cinder-81920 Dec 16 17:59:52.149051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-e4347a34-c5b6-4f0a-9d30-58318cd74dc2 req-892199b4-d091-46a9-b175-74c9674c0b7c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036858 Dec 16 17:59:52.153966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 377/772] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:59:52.279379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:52.287532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f843854c-cf8a-4f1c-92f1-f7f5e0449710 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.193878 Dec 16 17:59:52.288107 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 396/773] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:52 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:52.309311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:52.310318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:52.317054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.317461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.318231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.319309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.388919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f79dd2c8-6002-43d0-b006-17b343bf3c3c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.083581 Dec 16 17:59:52.389992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 378/774] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:52 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:52.602273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:52.602909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:52.611162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.611607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.612940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.613515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.648131 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:52.648486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:52.648967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lazy-loading 'fault' on Instance uuid 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 17:59:52.693926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:52.703150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-70da7ff0-4d78-4767-9822-375a1b9e49d4 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 200 len: 1308 microversion: 2.1 time: 0.106324 Dec 16 17:59:52.703749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 397/775] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:52 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:53.305096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:53.305824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:53.314654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.315105 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.315905 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.316325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.400939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:53.402661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:53.421250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.422049 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.423086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.423717 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.466175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:53.473561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-69d8dc0a-21d6-45fd-9bce-1bf44ccc6feb tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.172914 Dec 16 17:59:53.474135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 379/776] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:53 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:53.487792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a7d712a0-62a8-4bfc-a60f-94b8af202fe9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.090493 Dec 16 17:59:53.491793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 398/777] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:53 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:59:53.723754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:53.724496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:53.731356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.731843 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.732640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:53.733074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:53.749236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Instance 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e could not be found. Dec 16 17:59:53.750067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 404 to user: Instance 4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:53.750931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-91439996-687e-4d1b-97b5-0cab3c33b7f5 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e" status: 404 len: 111 microversion: 2.1 time: 0.031553 Dec 16 17:59:53.751512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 380/778] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:53 2021] GET /compute/v2.1/servers/4d6581ad-c9f6-4fc1-82ec-cd6273b3a83e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:54.491314 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:54.492078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:54.499607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:54.500586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.500817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:54.501118 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.501922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.502345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.507929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.508399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.509227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.509662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.638511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dd794931-a2b4-4a8e-8cf4-6f904987b13b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.142661 Dec 16 17:59:54.642829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 381/779] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:54 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:54.661657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:54.673338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1d6f37b5-1865-42fa-b73c-b4dd281ce6ed tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.186278 Dec 16 17:59:54.673960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 399/780] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:54 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:54.909952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:54.910535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:54.917637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.918068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.918866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:54.919287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:54.945451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 17:59:55.034866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-911a7d2f-287a-4ebb-92b0-5b7f97815f3c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 204 len: 0 microversion: 2.1 time: 0.128807 Dec 16 17:59:55.035449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 382/781] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 17:59:54 2021] DELETE /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 17:59:55.046931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:55.046931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:55.052433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.053109 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.054149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.054654 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.213405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:55.223188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-30e59d20-2685-47c9-83eb-fc7104e2e4d9 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1513 microversion: 2.1 time: 0.183075 Dec 16 17:59:55.223831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 400/782] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:55 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:55.651645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:55.653749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:55.664966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.665844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.666221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.666738 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.693222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:55.693799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:55.703908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.704516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.706230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.706838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.742050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b28567aa-c51a-42b7-8efc-d327abefa92f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.094433 Dec 16 17:59:55.743698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 383/783] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:55 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:55.844900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-56bbe5d1-83a1-4a8e-91ed-37e6f026e314 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:55.856073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56bbe5d1-83a1-4a8e-91ed-37e6f026e314 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:55.856870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56bbe5d1-83a1-4a8e-91ed-37e6f026e314 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:55.934171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-56bbe5d1-83a1-4a8e-91ed-37e6f026e314 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Going to try to stop instance {{(pid=115915) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 16 17:59:55.964439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:55.974972 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-454e67b9-af82-41d4-b5b6-71379a80da4f tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.287473 Dec 16 17:59:55.975906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 401/784] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:55 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:55.998334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-56bbe5d1-83a1-4a8e-91ed-37e6f026e314 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 202 len: 0 microversion: 2.1 time: 0.157857 Dec 16 17:59:55.999779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 384/785] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 17:59:55 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:59:56.007821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:56.008977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:56.015403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.016100 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.017073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.017672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.184087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-b5f1ac7c-177a-473b-9332-a777e8413561 req-44eb8503-c261-4216-b89f-e2c84344dc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4563a1d-2838-4e79-b193-2399bae7aec4", "name": "network-vif-plugged", "status": "completed", "tag": "ab7cf641-deaf-449b-a250-cbfc0164d60c"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:56.186925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:56.186925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 17:59:56.196080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b5f1ac7c-177a-473b-9332-a777e8413561 req-44eb8503-c261-4216-b89f-e2c84344dc3f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.196862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b5f1ac7c-177a-473b-9332-a777e8413561 req-44eb8503-c261-4216-b89f-e2c84344dc3f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.202415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:56.209705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e5afcd59-42cf-4345-aee0-4658a8970acb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.205906 Dec 16 17:59:56.210348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 402/786] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:56 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:56.212649 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-b5f1ac7c-177a-473b-9332-a777e8413561 req-44eb8503-c261-4216-b89f-e2c84344dc3f service nova] Creating event network-vif-plugged:ab7cf641-deaf-449b-a250-cbfc0164d60c for instance d4563a1d-2838-4e79-b193-2399bae7aec4 on hv-cinder-81920 Dec 16 17:59:56.219370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-b5f1ac7c-177a-473b-9332-a777e8413561 req-44eb8503-c261-4216-b89f-e2c84344dc3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040510 Dec 16 17:59:56.220324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 385/787] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 17:59:56.242064 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:56.242794 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:56.250408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.251062 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.252240 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.253304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.439517 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:56.447570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ba1c5af6-8d49-4396-b48e-8b4432adf3e8 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1513 microversion: 2.1 time: 0.210017 Dec 16 17:59:56.448148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 403/788] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:56 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:56.756061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:56.757158 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:56.764119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.764644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.765432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:56.765860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:56.865872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9377fb9a-1294-4e70-8248-8129b2cf657f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.114428 Dec 16 17:59:56.867432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 386/789] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:56 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:56.998872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:56.999691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:57.006129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.006578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.007414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.007879 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.150850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:57.159491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-090f0a8a-6a1f-4558-b0dc-7eae47a696a8 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.164295 Dec 16 17:59:57.160073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 404/790] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:56 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:57.228265 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:57.229156 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:57.237348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.237872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.238767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.239262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.391472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:57.399494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2243eeac-abb1-4554-aa4b-103f80af798f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.175460 Dec 16 17:59:57.400349 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 387/791] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:57 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:57.465045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:57.466219 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:57.482659 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.483106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.483900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.484712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.706823 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85da5cbc170449cb9f74d845845bc35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041391a20fed40f39c4d822b2a7727a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:57.714986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9f1d690b-0210-4697-a1aa-aff25a1f6f57 tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 200 len: 1513 microversion: 2.1 time: 0.253565 Dec 16 17:59:57.716504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 405/792] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:57 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:57.877864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:57.879104 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:57.889618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.891493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:57.892368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:57.893233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.003767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-c24057af-1d09-4066-8df9-f005e82ad632 req-f6828f12-d256-426a-8ddb-6d3638c17190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0661c266-f8da-443a-81eb-4f6b894dd906", "name": "network-vif-deleted", "tag": "16e14879-9e6e-4635-973a-9dd4e0786b26"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:58.007448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ae7f37e5-d0cf-4cdd-aa9a-a84ea7bea9c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.133176 Dec 16 17:59:58.008750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 388/793] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:57 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 17:59:58.010437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 17:59:58.010437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 17:59:58.018504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-c24057af-1d09-4066-8df9-f005e82ad632 req-f6828f12-d256-426a-8ddb-6d3638c17190 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.019241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-c24057af-1d09-4066-8df9-f005e82ad632 req-f6828f12-d256-426a-8ddb-6d3638c17190 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.031146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-c24057af-1d09-4066-8df9-f005e82ad632 req-f6828f12-d256-426a-8ddb-6d3638c17190 service nova] Creating event network-vif-deleted:16e14879-9e6e-4635-973a-9dd4e0786b26 for instance 0661c266-f8da-443a-81eb-4f6b894dd906 on hv-cinder-81920 Dec 16 17:59:58.036765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-c24057af-1d09-4066-8df9-f005e82ad632 req-f6828f12-d256-426a-8ddb-6d3638c17190 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Dec 16 17:59:58.038108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 406/794] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 17:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 17:59:58.177331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:58.178310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:58.186671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.187395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.188347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.188983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.442813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:58.447731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:58.458362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:58.467785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-40f9b696-e55b-40c2-84ed-cf6d365f50b2 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1319 microversion: 2.1 time: 0.294544 Dec 16 17:59:58.476927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 389/795] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:58 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:58.483714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.486222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.489032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.489719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.719294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:58.727967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-481ae678-4098-4f11-add8-8a96e81d8c84 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.311496 Dec 16 17:59:58.734488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:58.735136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] [instance: 0661c266-f8da-443a-81eb-4f6b894dd906] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:58.737622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 407/796] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:58 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 17:59:58.743803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.744531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.750583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:58.757231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:58.779332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] HTTP exception thrown: Instance 0661c266-f8da-443a-81eb-4f6b894dd906 could not be found. Dec 16 17:59:58.780348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] Returning 404 to user: Instance 0661c266-f8da-443a-81eb-4f6b894dd906 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 17:59:58.782425 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d01430be-65e4-443a-b6be-8e2ea646798c tempest-AttachVolumeNegativeTest-1273246867 tempest-AttachVolumeNegativeTest-1273246867-project] 10.222.0.32 "GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906" status: 404 len: 111 microversion: 2.1 time: 0.052770 Dec 16 17:59:58.783835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 390/797] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:58 2021] GET /compute/v2.1/servers/0661c266-f8da-443a-81eb-4f6b894dd906 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 17:59:59.020263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:59.021277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:59.030157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.031129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.032238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.032906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.106121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5943e486-7872-4399-ba43-fcbf09cc10ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.089909 Dec 16 17:59:59.106905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 408/798] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 17:59:59 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 17:59:59.487789 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:59.489757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:59.500036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.500905 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.502727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.504006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.651697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 17:59:59.659368 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-20def491-42bf-4767-b143-69acbb8dcc6d tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1507 microversion: 2.1 time: 0.178338 Dec 16 17:59:59.659883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 391/799] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:59 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 17:59:59.676991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d204b79-b7d2-4659-a6a3-1305552b31d3", "device": "/dev/sdb"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 17:59:59.679063 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:59.686883 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.687690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.688703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.689436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.744963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 17:59:59.746099 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 17:59:59.758031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.758441 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.759273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 17:59:59.759728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 17:59:59.996499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:00.007737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-33f36753-b375-4b5d-a4c0-3bb90fbea46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.266454 Dec 16 18:00:00.011141 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 392/800] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 17:59:59 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:00.015721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8ea06cd9-390d-4945-ab2e-ed1b0d53921a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "POST /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342908 Dec 16 18:00:00.016338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 409/801] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 17:59:59 2021] POST /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:00:00.118407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:00.119755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:00.125657 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:00.126279 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:00.127285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:00.127718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:00.212510 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-33fab05b-c473-45d1-84c9-a2591eb8eee9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.097427 Dec 16 18:00:00.213278 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 393/802] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:00 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:01.025758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:01.026473 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:01.032694 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:01.033136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:01.033897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:01.034323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:01.194982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:01.204178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b7fcb0dd-6428-4bb6-9db3-fdcea8a04885 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.182840 Dec 16 18:00:01.204752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 410/803] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:01 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:01.226504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:01.228022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:01.236134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:01.236593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:01.237362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:01.237785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:01.325721 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-00f11144-a085-4604-b8e8-498ef6c56053 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.102955 Dec 16 18:00:01.329728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 394/804] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:01 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:00:02.224335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:02.224946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:02.233710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:02.234281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:02.235106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:02.235540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:02.338294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:02.339458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:02.346945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:02.347387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:02.348176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:02.348637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:02.375607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:02.384946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d71c34dd-f7ff-4147-be67-00997de6a195 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.164384 Dec 16 18:00:02.385533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 411/805] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:02 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:02.415091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3008cd79-6b0f-455c-95e3-cb80834fa24b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.080832 Dec 16 18:00:02.415709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 395/806] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:02 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:03.404601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:03.405214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:03.411909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:03.412359 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:03.413158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:03.413601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:03.427608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:03.428660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:03.436330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:03.436809 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:03.437595 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:03.438047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:03.503006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-859ce305-eaea-4140-87e8-4ad990d1450e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.079336 Dec 16 18:00:03.503696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 396/807] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:03 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:03.551933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:03.559994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0348b52c-759f-461a-af99-78fbf016d415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.159870 Dec 16 18:00:03.560598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 412/808] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:03 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:04.516311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:04.517347 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:04.524600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:04.525029 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:04.525816 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:04.526238 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:04.581935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:04.582517 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:04.589603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-30bec707-feae-41a4-bca5-ee24c30fc529 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.077872 Dec 16 18:00:04.590290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 397/809] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:04 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:04.591635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:04.592515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:04.593406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:04.593866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:04.741652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:04.750735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f353695a-b8c8-480b-a741-af3de623921f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.172683 Dec 16 18:00:04.751354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 413/810] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:04 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:05.602444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:05.603469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:05.613652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:05.614088 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:05.614909 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:05.615344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:05.771868 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:05.772537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:05.781617 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:05.782043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:05.782886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:05.783326 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:05.950389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:05.964702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ac65ff87-2faf-46bd-ba9c-fd48fe7109b4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.198151 Dec 16 18:00:05.965719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 414/811] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:05 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:06.988630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:06.989315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:06.995882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:06.996330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:06.997117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:06.997646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:07.143231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:07.153145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-43567849-b582-4987-8714-e4edc1839341 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.168343 Dec 16 18:00:07.154999 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 415/812] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:06 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:00:08.171858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:08.172559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:08.179414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:08.179879 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:08.180780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:08.181262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:08.317760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:08.326264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6c662269-f905-490c-9355-9860b88bb46f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.158790 Dec 16 18:00:08.326864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 416/813] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:08 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:09.064312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-76ec1a34-0003-42a9-9bc0-08f26dcd0604 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.465832 Dec 16 18:00:09.064875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 398/814] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:05 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:09.344168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:09.344625 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:09.351262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:09.351706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:09.352510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:09.352940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:09.495859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:09.504899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5da6f102-823c-4227-9a9b-7ac1b9acb60f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.165066 Dec 16 18:00:09.505452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 417/815] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:09 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:10.077173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:10.078214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:10.085990 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:10.086432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:10.087496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:10.087930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:10.178069 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ad6eb44d-4ed1-431f-ab8f-a5433a1b9ee6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.105694 Dec 16 18:00:10.178757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 399/816] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:10 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:00:10.522014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:10.522557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:10.530265 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:10.530758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:10.531559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:10.531994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:10.678437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:10.698532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5b43fec3-6de2-4eeb-966b-bb675d2a4fe5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.180273 Dec 16 18:00:10.699157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 418/817] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:10 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:11.189971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:11.191680 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:11.199428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:11.200076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:11.200996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:11.201378 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:11.296237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-74092c93-2ad4-4af2-8cea-e6934b40fc21 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.110082 Dec 16 18:00:11.297163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 400/818] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:11 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:11.716619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:11.717238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:11.724224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:11.724650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:11.725499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:11.725933 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:11.882710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:11.894168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-44820fbd-98bd-46e2-8f00-e44bff64e8de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.181831 Dec 16 18:00:11.894760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 419/819] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:11 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:00:12.311636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:12.313133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:12.322412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:12.322944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:12.324039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:12.324522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:12.911687 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:12.912290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:12.919571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:12.919871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:12.920798 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:12.921246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:13.069992 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:13.078577 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-39860a66-5368-41b5-815b-2332cdae49e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.170700 Dec 16 18:00:13.079176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 420/820] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:12 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:14.104783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:14.105796 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:14.112981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:14.113420 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:14.114202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:14.114643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:14.422825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:14.430925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5a94fbaf-c63d-4afb-9873-ebf4edd84f6a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.334834 Dec 16 18:00:14.431523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 421/821] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:14 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:15.453317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:15.454078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:15.463845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:15.464538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:15.465893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:15.466423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:15.483813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d126c763-4f40-4413-9ff1-454e8b88be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.177550 Dec 16 18:00:15.488333 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 401/822] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:12 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:15.609404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:15.617635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e21b270b-bec0-4c72-b822-f5691da5abfd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1723 microversion: 2.1 time: 0.168373 Dec 16 18:00:15.618213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 422/823] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:15 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:00:16.497033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:16.498033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:16.506012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.506454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.507311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.507769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.585805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-604b467e-1cab-4a3b-8250-d4e1b2cfd8a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.092736 Dec 16 18:00:16.586458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 402/824] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:16 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:16.635354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:16.635968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:16.643005 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.643396 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.644212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.644715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.779702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:16.787955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b2f35596-b1a9-4291-ad71-3c52e152b5ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1700 microversion: 2.1 time: 0.156365 Dec 16 18:00:16.788526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 423/825] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:16 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:16.805058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0ee7440f-5fbb-458a-8b9a-7cc5dcd23083 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:16.812341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ee7440f-5fbb-458a-8b9a-7cc5dcd23083 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.812779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0ee7440f-5fbb-458a-8b9a-7cc5dcd23083 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.835765 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0ee7440f-5fbb-458a-8b9a-7cc5dcd23083 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Going to try to start instance {{(pid=115915) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 16 18:00:16.880672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0ee7440f-5fbb-458a-8b9a-7cc5dcd23083 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 202 len: 0 microversion: 2.1 time: 0.079566 Dec 16 18:00:16.881270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 403/826] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:00:16 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:16.889820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:16.890524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:16.896855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.897245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:16.898203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:16.898578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:17.070897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:17.080581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6206225a-d67e-4177-9178-1461520ea526 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1709 microversion: 2.1 time: 0.194452 Dec 16 18:00:17.081470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 424/827] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:16 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:17.597884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:17.598912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:17.605860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:17.606303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:17.607112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:17.607537 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:17.680341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4d948f5e-352a-4d60-bb36-a4c2415c117f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.086399 Dec 16 18:00:17.682663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 404/828] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:17 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:18.099260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:18.100294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:18.109334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:18.109813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:18.111033 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:18.111523 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:18.271499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:18.282229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8abaa6ed-9921-4533-b213-48ae5f89bb35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1709 microversion: 2.1 time: 0.186711 Dec 16 18:00:18.282988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 425/829] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:18 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:18.694593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:18.696361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:18.705326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:18.705757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:18.706531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:18.706982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:19.301927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:19.302660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:19.309388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:19.309867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:19.310732 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:19.311151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:19.458102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:19.466278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ad165f35-34b6-493a-9a0d-5daad55738c3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1709 microversion: 2.1 time: 0.168276 Dec 16 18:00:19.466902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 426/830] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:19 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:20.485963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:20.486705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:20.493403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:20.493844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:20.494647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:20.495096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:20.658860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:20.668201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c50e12a0-9d89-4938-ad29-24dfd4a2a721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1709 microversion: 2.1 time: 0.186500 Dec 16 18:00:20.668814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 427/831] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:20 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:21.687349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:21.688050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:21.694935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:21.695380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:21.696157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:21.696579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:21.828595 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:21.833840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-16072f63-32ac-4b04-a2b0-b79ea75915b4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.144062 Dec 16 18:00:21.834508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 405/832] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:18 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:21.837773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-69c8d1a0-8d84-4847-a416-f5ca04d3e5de tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1709 microversion: 2.1 time: 0.154528 Dec 16 18:00:21.838382 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 428/833] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:21 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:22.847154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:22.848165 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:22.854995 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:22.855601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:22.855807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:22.856256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:22.857044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:22.857477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:22.862905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:22.863461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:22.864137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:22.864890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:22.934907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f311904d-2d66-4574-a2bd-af53fa8b0ef9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.091604 Dec 16 18:00:22.936136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 406/834] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:22 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:23.011715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:23.020830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-231d74f4-dc55-4e0a-9472-120a76ea9755 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1713 microversion: 2.1 time: 0.169484 Dec 16 18:00:23.021586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 429/835] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:22 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:00:23.950729 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:23.951947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:23.959295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:23.959738 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:23.960519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:23.960945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:24.058363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-12b72dfe-f231-4cb1-982f-f88595a5be2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.112828 Dec 16 18:00:24.059036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 407/836] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:23 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:25.071476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:25.072504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:25.080666 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:25.081186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:25.082391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:25.084459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:25.151359 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-47186bc2-33a6-4840-80fb-612de43b11a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.084572 Dec 16 18:00:25.152013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 430/837] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:25 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:26.038389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:00:26.038974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:00:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:00:26.164945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:26.166034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:26.174125 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:26.174694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:26.175501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:26.175935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:26.243574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2b329a42-9730-4b49-ad9f-5d5b8929f140 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.082844 Dec 16 18:00:26.244764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 408/838] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:26 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:26.702294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:26.702913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:26.710086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:26.710526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:26.711344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:26.711776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:26.793851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lazy-loading 'services' on Instance uuid d4563a1d-2838-4e79-b193-2399bae7aec4 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:00:26.877423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9cbb43ba-4194-421a-a5f6-dbeeadd5597a tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4/os-volume_attachments/9d204b79-b7d2-4659-a6a3-1305552b31d3" status: 202 len: 0 microversion: 2.1 time: 0.179224 Dec 16 18:00:26.878416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 431/839] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:00:26 2021] DELETE /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4/os-volume_attachments/9d204b79-b7d2-4659-a6a3-1305552b31d3 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:27.258163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:27.259295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:27.266938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:27.267448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:27.268186 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:27.268618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:27.356577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-866aa1c7-2306-47f8-bc9b-70354279dbf0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.102328 Dec 16 18:00:27.360998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 409/840] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:27 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:00:27.997948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:27.998817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:28.008442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.008966 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.010136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.010776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.038543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:00:28.129194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bdf2505c-b814-47dc-8022-ed7c671c3e79 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 204 len: 0 microversion: 2.1 time: 0.136041 Dec 16 18:00:28.129800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 432/841] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:00:27 2021] DELETE /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:00:28.141753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:28.142492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:28.149587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.150036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.150864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.151292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.373641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:28.375161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:28.382048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:28.391591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.392039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.392847 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:28.393274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:28.396288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-36e296f8-db16-4732-b776-702576603135 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1513 microversion: 2.1 time: 0.260517 Dec 16 18:00:28.404011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 410/842] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:28 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:28.471713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-522ab9d7-19ce-4f67-b420-705ecf22541b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.103978 Dec 16 18:00:28.472533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 433/843] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:28 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:00:29.423155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:29.423756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:29.430834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:29.431267 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:29.432152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:29.432597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:29.484597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:29.485618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:29.493111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:29.493560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:29.494369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:29.494834 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:29.560582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e3b750ae-e0cf-4d5d-9842-ed2776eb7411 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.080490 Dec 16 18:00:29.561630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 434/844] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:29 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:29.579696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:29.587492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2c342932-0eb5-4f4d-ac5e-5f40ede31700 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1513 microversion: 2.1 time: 0.168785 Dec 16 18:00:29.588188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 411/845] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:29 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:00:30.576843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:30.578287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:30.586588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:30.587061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:30.587854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:30.588504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:30.605313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:30.606002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:30.614002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:30.614849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:30.615338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:30.615762 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:30.666791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d24f02c2-9e22-40cc-abaa-7619ca029dac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.097411 Dec 16 18:00:30.671898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 435/846] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:30 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:30.762764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a1432173174bfd86f945f8ea925934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d5cb18f27d4ce1a89b1f5698ebcbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:00:30.771634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ab6d8964-7277-431b-b10b-48f46a24b1e9 tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 200 len: 1513 microversion: 2.1 time: 0.169939 Dec 16 18:00:30.772249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 412/847] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:30 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:00:31.281717 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-b9ad9fea-dcd4-4bac-93ef-8a03bdbd6683 req-0d34da1b-f5e0-48d5-9121-a2be5d907d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4563a1d-2838-4e79-b193-2399bae7aec4", "name": "network-vif-deleted", "tag": "ab7cf641-deaf-449b-a250-cbfc0164d60c"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:31.284136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:00:31.284136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:00:31.293163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b9ad9fea-dcd4-4bac-93ef-8a03bdbd6683 req-0d34da1b-f5e0-48d5-9121-a2be5d907d99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:31.293600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b9ad9fea-dcd4-4bac-93ef-8a03bdbd6683 req-0d34da1b-f5e0-48d5-9121-a2be5d907d99 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:31.315163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-b9ad9fea-dcd4-4bac-93ef-8a03bdbd6683 req-0d34da1b-f5e0-48d5-9121-a2be5d907d99 service nova] Creating event network-vif-deleted:ab7cf641-deaf-449b-a250-cbfc0164d60c for instance d4563a1d-2838-4e79-b193-2399bae7aec4 on hv-cinder-81920 Dec 16 18:00:31.320375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-b9ad9fea-dcd4-4bac-93ef-8a03bdbd6683 req-0d34da1b-f5e0-48d5-9121-a2be5d907d99 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044972 Dec 16 18:00:31.321575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 436/848] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:00:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:00:31.613562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:00:31.613562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:00:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:00:31.680506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:31.681719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:31.689090 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:31.689744 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:31.690745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:31.691247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:31.761868 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8398e70f-ff0c-40c2-8989-898ecb234d17 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.084282 Dec 16 18:00:31.766056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 413/849] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:31 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:00:31.789912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:00:31.790886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] [instance: d4563a1d-2838-4e79-b193-2399bae7aec4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:31.805184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:31.805673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:31.808921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:31.808921 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:31.821633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] HTTP exception thrown: Instance d4563a1d-2838-4e79-b193-2399bae7aec4 could not be found. Dec 16 18:00:31.822268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] Returning 404 to user: Instance d4563a1d-2838-4e79-b193-2399bae7aec4 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:00:31.823199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-91034f0d-1ef7-4059-a716-ad722d3f622c tempest-VolumesSnapshotTestJSON-1242004409 tempest-VolumesSnapshotTestJSON-1242004409-project] 10.222.0.32 "GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4" status: 404 len: 111 microversion: 2.1 time: 0.037356 Dec 16 18:00:31.823826 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 437/850] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:00:31 2021] GET /compute/v2.1/servers/d4563a1d-2838-4e79-b193-2399bae7aec4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:00:32.774171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:32.775219 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:32.783397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:32.783837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:32.784629 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:32.785064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:32.849840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a69c6711-692f-4cf4-a91e-3856fa552a2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.079448 Dec 16 18:00:32.850664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 414/851] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:32 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:33.863443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:33.864481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:33.871702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:33.872398 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:33.873176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:33.873738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:37.447610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a575435e-a830-454e-bee8-a7b2f2f932fb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.588320 Dec 16 18:00:37.448336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 438/852] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:33 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3591 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:38.460082 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:38.461719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:38.469306 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:38.470056 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:38.470739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:38.471167 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:41.625554 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f45daab3-b2bb-4c3c-b686-0f0888279ced tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.169168 Dec 16 18:00:41.626457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 415/853] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:38 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:42.641581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:42.642588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:42.650715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:42.651147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:42.651932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:42.652364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:42.721585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6c02b9ba-9825-4908-80a2-51e70e3d22d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.085676 Dec 16 18:00:42.722243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 439/854] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:42 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:43.734337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:43.735407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:43.744271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:43.744696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:43.745541 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:43.745970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:46.539743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cf8400bf-aeaa-4aa0-9b36-418deea89b1e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 2.809371 Dec 16 18:00:46.540516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 416/855] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:43 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:47.553079 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:47.554082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:47.561578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:47.562040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:47.562941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:47.563376 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:47.642572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aafab3e2-e34c-4c8f-af25-c0973043a260 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.093316 Dec 16 18:00:47.643280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 440/856] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:47 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:48.656671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:48.658362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:48.666856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:48.667296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:48.668081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:48.674504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:48.765235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-81e4b965-1290-4094-a551-8a5eefa56bd2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.113200 Dec 16 18:00:48.766040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 417/857] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:48 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:49.779791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:49.782195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:49.789200 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:49.789675 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:49.790465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:49.790947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:49.862098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8b3acec0-bccd-4c35-b9ad-cf8081ede254 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.087586 Dec 16 18:00:49.862881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 441/858] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:49 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:50.874848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:50.876053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:50.883380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:50.884043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:50.884823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:50.885270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:50.961258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-65bf711a-a816-4c04-ab07-8b9dfa0a7760 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.090773 Dec 16 18:00:50.962011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 418/859] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:50 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:51.974165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:51.975485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:51.982338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:51.982816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:51.983597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:51.984025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:55.377748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cfac7f97-26e7-4567-a02d-7fedf686cab8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.406850 Dec 16 18:00:55.378867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 442/860] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:51 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3410 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:56.395116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:56.396105 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:56.403641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:56.404090 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:56.404886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:56.405319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:56.471888 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2f09c9ce-cca6-4a07-8eda-de109f31e993 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.081293 Dec 16 18:00:56.472588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 419/861] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:56 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:57.486973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:57.488648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:57.499650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:57.500299 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:57.501686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:57.502432 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:57.598759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3f7f6942-9e87-43d0-adfe-ddf3034096f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.117581 Dec 16 18:00:57.599428 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 443/862] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:57 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:00:58.611344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:00:58.612771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:00:58.620126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:58.620574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:00:58.621465 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:00:58.621966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:01.765420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3567f34f-9d73-461b-8971-8dac9457acea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 3.158072 Dec 16 18:01:01.766154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 420/863] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:00:58 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 3160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:02.777804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:02.778853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:02.786305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:02.786779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:02.787576 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:02.788012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:02.855605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-50ecb4f8-c2ba-4e2a-a672-c163661ec947 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.081528 Dec 16 18:01:02.856328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 444/864] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:02 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:01:03.869640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:03.869640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:03.879353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:03.879353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:03.880023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:03.880441 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:03.955196 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e82aedb6-6b13-4b03-a015-e5d9d34f88d2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 28677 microversion: 2.20 time: 0.090147 Dec 16 18:01:03.955972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 421/865] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:03 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 28677 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:01:04.968186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:04.969467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:04.976736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:04.977176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:04.977950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:04.978376 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:05.060206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c6aed37a-356e-4780-aaac-69c53318cdaa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 29641 microversion: 2.20 time: 0.096248 Dec 16 18:01:05.061018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 445/866] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:04 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 29641 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:06.072803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:06.073895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:06.081922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:06.082429 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:06.083350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:06.083854 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:06.171772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-02afedde-0bd6-4861-9e60-bfe23226eb37 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 31376 microversion: 2.20 time: 0.102916 Dec 16 18:01:06.175834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 422/867] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:06 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 31376 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:07.184128 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:07.185144 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:07.192311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:07.192771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:07.193561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:07.193994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:07.280412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fcfb2a51-d13d-4a43-b2bd-ced35d40ba24 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 33018 microversion: 2.20 time: 0.100012 Dec 16 18:01:07.284698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 446/868] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:07 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 33018 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:08.293535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:08.294650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:08.301826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:08.302271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:08.303222 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:08.303667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:08.388017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7965d211-ddf0-459a-8605-376f14132297 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 33806 microversion: 2.20 time: 0.098674 Dec 16 18:01:08.389828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 423/869] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:08 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 33806 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:09.401204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:09.402206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:09.409579 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:09.410045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:09.410950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:09.411374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:09.491877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9d4a057d-57b9-463d-b151-2d6405494306 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 34969 microversion: 2.20 time: 0.094484 Dec 16 18:01:09.492521 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 447/870] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:09 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 34969 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:10.506797 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:10.507719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:10.515142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:10.515593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:10.516381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:10.516814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:10.593817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1dd98741-af84-457e-b626-a3aea565570a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 35895 microversion: 2.20 time: 0.091976 Dec 16 18:01:10.594468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 424/871] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:10 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 35895 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:11.609465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:11.610459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:11.618169 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:11.618680 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:11.619461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:11.619892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:11.701485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8e254a4d-0f23-4a2a-9f10-5f53ece19bb1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 37309 microversion: 2.20 time: 0.096051 Dec 16 18:01:11.702031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 448/872] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:11 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 37309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:12.714560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:12.716817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:12.723908 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:12.724361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:12.725175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:12.725634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:12.809466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2b8be817-83d5-44c9-8ad9-3ab2d2caa721 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 38230 microversion: 2.20 time: 0.098839 Dec 16 18:01:12.810286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 425/873] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:12 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 38230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:13.823490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:13.824646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:13.835639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:13.835639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:13.835639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:13.835639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:13.905647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3b3a7477-7dfd-47b3-8dc6-fd738a0f2683 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 38230 microversion: 2.20 time: 0.085942 Dec 16 18:01:13.909065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 449/874] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:13 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 38230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:14.918605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:14.919772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:14.927157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:14.927614 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:14.928443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:14.928850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:14.998433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2553db6c-90cc-41cc-8c75-b2e16eeeb511 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 38230 microversion: 2.20 time: 0.083960 Dec 16 18:01:14.999133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 426/875] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:14 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 38230 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:16.013564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:16.014585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:16.027268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:16.027268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:16.027268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:16.027268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:16.099540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c52d9bbf-4f06-40a4-8e2e-e264a178ac46 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 38230 microversion: 2.20 time: 0.090471 Dec 16 18:01:16.100370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 450/876] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:16 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 38230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:17.112315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:17.113851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:17.122112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:17.122653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:17.123510 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:17.123973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:17.200820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9d97562f-776c-4142-b64f-4715a1069a2b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 200 len: 38371 microversion: 2.20 time: 0.092321 Dec 16 18:01:17.201454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 427/877] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:17 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 38371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:17.213007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:17.214345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:17.229463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:17.230192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:17.231433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:17.232165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:17.262896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0700a311-3079-4bd4-b178-f0d0010d5405 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/ips" status: 200 len: 152 microversion: 2.20 time: 0.054198 Dec 16 18:01:17.263498 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 451/878] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Dec 16 18:01:17 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:01:19.523173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:19.523801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:19.531112 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:19.531561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:19.532349 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:19.532782 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:19.557176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lazy-loading 'flavor' on Instance uuid 5f9dd6ae-7f47-4593-bf30-0df596f5046a {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:01:19.847728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-23782bdb-ce21-4527-bff8-d01093139490 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 202 len: 0 microversion: 2.20 time: 0.328568 Dec 16 18:01:19.848388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 428/879] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:01:19 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:01:19.857882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:19.858500 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:19.865780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:19.865780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:19.866830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:19.867311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:20.011004 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:20.018886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:20.020631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:20.021791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-99e7d027-3a5f-4e33-836f-18e04d14199e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.167719 Dec 16 18:01:20.026674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 452/880] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:19 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:21.041469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:21.042068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:21.048806 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:21.049247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:21.050018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:21.050445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:21.187962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:21.199679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:21.201936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:21.203502 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-19fc6076-04b4-45fe-9c2d-41ec174d0034 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.166860 Dec 16 18:01:21.204095 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 429/881] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:21 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:22.223942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:22.224589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:22.231274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:22.231709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:22.232632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:22.233073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:22.374602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:22.382947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:22.384470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:22.385672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6b7bd787-fb0b-4885-a60b-b4249d06b7e8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.165680 Dec 16 18:01:22.386238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 453/882] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:22 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:23.403926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:23.404540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:23.411370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:23.411815 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:23.412870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:23.413157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:23.563974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:23.577576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:23.579633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:23.581831 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4571ba1a-1e03-4f51-95f6-56f07a1725ec tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.181501 Dec 16 18:01:23.582525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 430/883] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:23 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:24.602062 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:24.602855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:24.609660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:24.610128 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:24.610986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:24.611459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:24.756447 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:24.765474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:24.767007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:24.768183 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f2ebc6e0-cf90-4de8-b83f-b8820ea1c57d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.170576 Dec 16 18:01:24.768758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 454/884] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:24 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:25.786921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:25.787581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:25.794431 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:25.795596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:25.796722 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:25.797175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:25.944455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:25.953123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:25.954665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:25.955864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7fe3dfed-94ea-4895-80bd-a460fbdbf092 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.172918 Dec 16 18:01:25.956433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 431/885] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:25 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:26.977377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:26.978196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:26.985374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:26.985967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:26.986776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:26.987205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:27.143603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:27.155399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:27.157103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:27.158957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c2e00a62-8811-4df8-8796-53c8ddeb7cb7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.186631 Dec 16 18:01:27.159668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 455/886] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:26 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:28.178538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:28.179204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:28.185248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:28.185686 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:28.186464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:28.186918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:28.400891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:28.409149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:28.410714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:28.411907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-05467772-7de0-4938-b100-d87513eaaaac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.237510 Dec 16 18:01:28.412777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 432/887] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:28 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:29.431220 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:29.431812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:29.439770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:29.440350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:29.441338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:29.441850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:29.581534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:29.590402 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:29.592162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:29.593338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8697d1a4-2ab5-4c94-ab58-6fc7bf6014a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.166530 Dec 16 18:01:29.593889 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 456/888] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:29 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:30.613993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:30.615205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:30.621748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:30.622221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:30.623097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:30.623566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:30.785070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:30.798436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:30.800833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:30.802089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2b2f4f39-1bb4-4dd4-ac38-a6b8aa94d145 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.192239 Dec 16 18:01:30.802681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 433/889] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:30 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:31.821771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:31.822388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:31.830378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:31.830865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:31.831670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:31.832114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:32.048703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:32.063383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:32.066444 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:32.068753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d3d8b2ea-f52b-4229-8c94-01a471e78393 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.250764 Dec 16 18:01:32.069919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 457/890] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:31 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:33.096881 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:33.098795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:33.112087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:33.112994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:33.114779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:33.116126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:33.310876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:33.332926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:33.336360 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:33.337609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b6634f0e-a948-4a5b-919f-302f4669cfc6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.251580 Dec 16 18:01:33.338833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 434/891] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:33 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:34.356833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:34.357744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:34.365016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:34.365714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:34.366993 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:34.367667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:34.518227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:34.530604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:34.532113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:34.533280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-567ce594-55cb-4d05-968d-9221834a4eeb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.180508 Dec 16 18:01:34.533843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 458/892] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:34 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:35.552985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:35.554551 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:35.562118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:35.562958 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:35.564027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:35.564714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:35.766761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:35.779662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:35.782488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:35.784258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-81b2447a-8b61-4453-8603-f2353d9303cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.236214 Dec 16 18:01:35.785036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 435/893] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:35 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:36.803005 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:36.804468 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:36.813876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:36.816703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:36.817801 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:36.820527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:37.161284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:37.198481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:37.200902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:37.202377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c2ab0637-216c-433b-801a-e1afc46af9ac tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1745 microversion: 2.20 time: 0.403136 Dec 16 18:01:37.205021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 459/894] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:36 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1745 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:38.223983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:38.225281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:38.233105 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:38.233896 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:38.236126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:38.236949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:38.491181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:38.499867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:38.501399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:38.502670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9939cbb0-3cf3-4fd2-8e18-1eb584207266 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1745 microversion: 2.20 time: 0.282550 Dec 16 18:01:38.503279 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 436/895] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:38 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:39.401404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-001433ad-06bc-42bf-a912-43e8c104710a req-6373b482-52d3-458a-9990-41f6d53d4bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "name": "network-vif-plugged", "status": "completed", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:39.403098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:01:39.403098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:01:39.410759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-001433ad-06bc-42bf-a912-43e8c104710a req-6373b482-52d3-458a-9990-41f6d53d4bad service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:39.411211 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-001433ad-06bc-42bf-a912-43e8c104710a req-6373b482-52d3-458a-9990-41f6d53d4bad service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:39.429900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-001433ad-06bc-42bf-a912-43e8c104710a req-6373b482-52d3-458a-9990-41f6d53d4bad service nova] Creating event network-vif-plugged:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 18:01:39.451010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-001433ad-06bc-42bf-a912-43e8c104710a req-6373b482-52d3-458a-9990-41f6d53d4bad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249220 Dec 16 18:01:39.452124 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 460/896] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:01:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:01:39.521903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:39.522597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:39.528985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:39.529661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:39.530641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:39.531231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:39.727031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:39.735716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:39.737548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:39.738826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d00c0a3f-4385-42b3-afcc-1aa57d6d87a5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1745 microversion: 2.20 time: 0.221263 Dec 16 18:01:39.739595 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 437/897] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:39 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:40.759362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:40.760721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:40.774939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:40.775391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:40.776202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:40.778914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:40.976380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:40.987152 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:40.989028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:40.990426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8c3e1556-2445-4018-9e3d-666d2ddcd4f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1745 microversion: 2.20 time: 0.236580 Dec 16 18:01:40.991569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 461/898] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:40 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:42.010280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:42.011119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:42.025702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:42.026677 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:42.027834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:42.033451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:42.240214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:42.250323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:42.258316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:42.259617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fdf3cf70-f8da-4334-b215-188d5fbd64f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1745 microversion: 2.20 time: 0.253618 Dec 16 18:01:42.260200 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 438/899] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:42 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:42.768352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:42.769479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:42.780295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:42.780963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:42.781965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:42.782596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:42.884531 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lazy-loading 'services' on Instance uuid 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:01:43.014817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fe211b48-63b3-4f50-b2a6-be7c55583fbe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments/54a88c07-f1bc-4a28-ac81-c22ce687dc0e" status: 202 len: 0 microversion: 2.1 time: 0.427298 Dec 16 18:01:43.046051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 462/900] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:01:42 2021] DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments/54a88c07-f1bc-4a28-ac81-c22ce687dc0e => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:01:43.284415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:43.285311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:43.295048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:43.295977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:43.297119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:43.297767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:43.484579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:43.497325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:43.499031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:43.500461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fa3ad0f3-db38-4438-9c9b-0a14237e1795 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.219847 Dec 16 18:01:43.502127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 439/901] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:43 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:44.227506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-062b5260-300b-4e5f-a8d7-5ad5b9e5cc35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:44.238387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-062b5260-300b-4e5f-a8d7-5ad5b9e5cc35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:44.238871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-062b5260-300b-4e5f-a8d7-5ad5b9e5cc35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:44.340437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-062b5260-300b-4e5f-a8d7-5ad5b9e5cc35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Going to try to stop instance {{(pid=115914) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 16 18:01:44.402381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-062b5260-300b-4e5f-a8d7-5ad5b9e5cc35 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 202 len: 0 microversion: 2.1 time: 0.182656 Dec 16 18:01:44.403902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 463/902] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:01:44 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:01:44.418777 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:44.420203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:44.433184 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:44.433931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:44.435128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:44.435969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:44.522975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:44.524235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:44.538404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:44.538889 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:44.539704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:44.546988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:44.744070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:44.761104 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-599dee34-c093-432a-9450-dacc7b725f60 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.349668 Dec 16 18:01:44.770961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 440/903] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:44 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:44.847035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:44.859157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:44.860674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:44.861887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9f9e967d-4fa2-41e7-ae7b-bbd966844026 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.344284 Dec 16 18:01:44.863888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 464/904] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:44 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:45.785907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:45.786578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:45.804595 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:45.806063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:45.820339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:45.821058 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:45.885344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:45.886729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:45.898599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:45.917129 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:45.929112 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:45.931417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:46.207285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:46.227878 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc373d88-3c12-4b23-bbb3-d89329668e1d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.445884 Dec 16 18:01:46.229539 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 441/905] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:45 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:46.320474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:46.332342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:46.333946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:46.335373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-20ac345f-d05c-437b-a7e6-639ff6001db4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.454059 Dec 16 18:01:46.346650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 465/906] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:45 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:47.271627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:47.272370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:47.284123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:47.284570 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:47.285708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:47.286329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:47.384349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:47.385763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:47.400034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:47.401855 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:47.403584 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:47.404273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:47.611625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:47.619950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-03e68bd6-0030-4cdb-8fa5-1b0854e1f96d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.352098 Dec 16 18:01:47.621864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 442/907] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:47 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:47.673842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:47.699244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:47.720710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:47.721971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-78e37fd2-fbf6-4c75-a0bd-aa4685cdd010 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.369091 Dec 16 18:01:47.726300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 466/908] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:47 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:48.638479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:48.640212 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:48.648603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:48.649426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:48.650764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:48.651266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:48.742678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:48.743940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:48.760013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:48.769898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:48.771119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:48.771571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:48.866249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:48.875065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-26843f94-b2fe-45f4-b68b-8f0564c7e8d3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.240509 Dec 16 18:01:48.880281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 443/909] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:48 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:48.988679 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:48.999745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:49.001300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:49.002871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f350e626-0c38-4bd4-9831-ca9739a9767c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.264861 Dec 16 18:01:49.003766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 467/910] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:48 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:49.898524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:49.899856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:49.913075 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:49.916845 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:49.918870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:49.921170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:50.024929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:50.025551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:50.035475 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:50.035924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:50.036752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:50.037184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:50.243720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:50.263410 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cdb6896c-42f0-4d4c-943d-1476e098e3cd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.371743 Dec 16 18:01:50.263692 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 444/911] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:49 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:50.292458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:50.301185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:50.302853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:50.304934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-afa8e2d1-f142-4034-8f2c-a449493b693c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.284342 Dec 16 18:01:50.312724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 468/912] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:50 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:51.281374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:51.281915 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:51.293370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:51.294063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:51.295017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:51.295562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:51.323247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:51.323865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:51.344050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:51.344512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:51.345657 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:51.346403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:51.523655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:51.533435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f70ea992-a162-422d-915a-cb2a82ce79df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.255467 Dec 16 18:01:51.545643 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 445/913] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:51 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:51.630265 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:51.648512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:51.650972 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:51.652778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0e369df3-d4d0-43dc-8813-dab6abf82be8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.333269 Dec 16 18:01:51.664353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 469/914] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:51 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:51.884846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'create', calling method: .version_select at 0x7fca1c047f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-371199625"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:51.917039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:01:51.922467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for user dad1fd17242e4ae9aecd40a9029be1b2 and project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:01:52.180714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:01:52.186508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for user dad1fd17242e4ae9aecd40a9029be1b2 and project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:01:52.203129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b476b105-3ace-4edd-83ed-b160437ae058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.322232 Dec 16 18:01:52.204329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 446/915] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Dec 16 18:01:51 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:52.263293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-28305748", "imageRef": "a7ce16c5-4b82-47b3-b010-a849279e8a82", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-371199625", "networks": [{"uuid": "b02ceb61-4e66-443a-8dd0-626b884c5568"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:52.321147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] validate_networks() for [('b02ceb61-4e66-443a-8dd0-626b884c5568', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:01:52.550858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:52.551473 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:52.566023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.566826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.567833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.568593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.726205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:52.734760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c7ca1c04-85a6-48e7-aee4-962ef3a17cf2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.188090 Dec 16 18:01:52.735938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 447/916] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:52 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:52.741488 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:52.742312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:52.754930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.755581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.756622 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.757217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.886073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:01:52.886683 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:01:52.887186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:01:52.887586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:01:52.887988 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:01:52.898494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.899199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.900193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:52.900777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:52.920605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:01:52.924869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Getting quotas for user dad1fd17242e4ae9aecd40a9029be1b2 and project b15f37c1016f4bf69ab6e241b39cbefb. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:01:52.932458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:52.937051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:01:52.939499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7ce16c5-4b82-47b3-b010-a849279e8a82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:01:52.942560 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:52.944264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:52.945647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-207421f4-d0ff-43e1-8574-28b9c9cbecef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.208162 Dec 16 18:01:52.947912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 448/917] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:52 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:52.991512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-79393efd-812d-44fc-a87e-df6d63886c45 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731509 Dec 16 18:01:52.992653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 470/918] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 18:01:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 18:01:53.002217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-586bacb7-4923-4f10-aa3f-f13e35f7a8d5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:53.004241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-586bacb7-4923-4f10-aa3f-f13e35f7a8d5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:53.069704 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-586bacb7-4923-4f10-aa3f-f13e35f7a8d5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:53.079445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-586bacb7-4923-4f10-aa3f-f13e35f7a8d5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1256 microversion: 2.1 time: 0.080861 Dec 16 18:01:53.081196 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 449/919] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:52 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1256 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:53.768157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:53.769187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:53.783153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:53.783935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:53.784954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:53.785591 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:53.969795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:53.971188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:53.979371 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:53.980261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:53.981256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:53.981834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:54.036844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:54.047711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e93bc133-9a86-4de0-8dca-f18e35257025 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.299020 Dec 16 18:01:54.048498 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 471/920] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:53 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:01:54.098312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:54.099268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:54.108291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:54.108743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:54.109720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:54.110324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:54.175216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:54.183157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:54.186152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:54.188237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:54.189646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1bb92530-8957-45a5-90a3-4db7a8438827 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.227245 Dec 16 18:01:54.190409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 450/921] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:53 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:54.192784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6e853d10-5059-4106-b227-3c7b435090eb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1308 microversion: 2.1 time: 0.099189 Dec 16 18:01:54.193820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 472/922] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:54 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:01:55.066755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:55.067805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:55.077134 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.081129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.082837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.084289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.210073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:55.210875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:55.217969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.223344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.224417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.227753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.299650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:55.311106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4efac084-f93e-499c-b3b7-bd5de4d91404 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.249274 Dec 16 18:01:55.325912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 451/923] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:55 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:55.336808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:55.338206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:55.355068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.356787 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.357974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:55.358979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:55.554043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:55.569448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6498adeb-23a1-402c-9344-b5cb0627a181 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.240181 Dec 16 18:01:55.577234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 452/924] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:55 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:55.682063 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:55.690015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:55.691537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:55.692778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9ca16ab8-fd28-4af3-bc51-5dd50965cefe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.487312 Dec 16 18:01:55.693384 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 473/925] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:55 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:56.328770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:56.329344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:56.336978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.337436 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.338227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.338656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.487776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:56.496406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-df946737-82bd-4372-aa75-af93a5f5d430 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.171488 Dec 16 18:01:56.496849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 453/926] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:56 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:56.595067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:56.595953 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:56.604311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.604753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.605603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.606035 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.713630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:56.714542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:56.720557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.720998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.721774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:56.722210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:56.758153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:56.774215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d824f291-1af5-422f-a3ca-628b592b8af9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.183492 Dec 16 18:01:56.776768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 474/927] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:56 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:56.867397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:56.876063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:56.877678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:56.878885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-26be5d48-629c-450f-ab6d-2c1e6129c4b5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.169056 Dec 16 18:01:56.879498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 454/928] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:56 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:57.517744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:57.518349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:57.524913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.525349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.526145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.526569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.669900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:57.677856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-deb41928-4659-441d-a88a-d235e107ebec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.163872 Dec 16 18:01:57.678738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 475/929] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:57 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:57.792202 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:57.792812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:57.799949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.800395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.801316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.801743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.899509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:57.900589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:57.909253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.910052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.911149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:57.912260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:57.957696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:57.966499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-820ef263-5c07-417a-8413-e89ffa225422 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.178091 Dec 16 18:01:57.967285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 455/930] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:57 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:58.066949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:58.075452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:58.076968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:58.078172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-96231351-0780-40fc-a49a-9ed2e7518ae8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.184390 Dec 16 18:01:58.078774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 476/931] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:57 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:01:58.696133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:58.696861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:58.703399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-bc886990-782f-4a16-a33d-28fab4cbadac req-61c8e30b-1764-45b5-89f2-9aac3b48e965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "name": "network-vif-unplugged", "status": "completed", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:01:58.704337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:58.704337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:58.705053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:01:58.705053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:01:58.705284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:58.705700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:58.713249 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-bc886990-782f-4a16-a33d-28fab4cbadac req-61c8e30b-1764-45b5-89f2-9aac3b48e965 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:58.713975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-bc886990-782f-4a16-a33d-28fab4cbadac req-61c8e30b-1764-45b5-89f2-9aac3b48e965 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:58.733471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-bc886990-782f-4a16-a33d-28fab4cbadac req-61c8e30b-1764-45b5-89f2-9aac3b48e965 service nova] Creating event network-vif-unplugged:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 18:01:58.739375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-bc886990-782f-4a16-a33d-28fab4cbadac req-61c8e30b-1764-45b5-89f2-9aac3b48e965 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039831 Dec 16 18:01:58.740663 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 477/932] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:01:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:01:58.933381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:58.943496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-31970ef0-696e-4e07-836e-a919b2cf5d31 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.251873 Dec 16 18:01:58.944836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 456/933] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:58 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:01:58.986660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:58.987481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:58.998047 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:58.998487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:58.999345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:58.999778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:59.099294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:59.099294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:59.105683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:59.106428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:59.107439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:59.108035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:59.173260 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:59.181356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0cb939c8-a9c9-473b-93cf-dcc67d6a14ec tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.199723 Dec 16 18:01:59.190890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 478/934] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:58 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:01:59.265128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:59.274727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:59.276708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:01:59.277963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5f95406a-f75e-4587-b674-4506f3c76cc1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.184830 Dec 16 18:01:59.278662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 457/935] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:01:59 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:01:59.965754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:01:59.966420 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:01:59.975115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:59.975802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:01:59.976597 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:01:59.977097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:00.132831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:00.141471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fa970e42-725c-49d0-aa54-95360649b397 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.182678 Dec 16 18:02:00.142276 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 479/936] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:01:59 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:00.199827 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:00.200685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:00.207846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:00.208298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:00.209967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:00.210445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:00.297295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:00.297947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:00.305202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:00.305639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:00.306451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:00.306909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:00.357309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:00.364803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-45b27806-1531-4ea6-a50f-49724bc19f95 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.169571 Dec 16 18:02:00.365593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 458/937] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:00 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:00.453019 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:00.461713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:00.463246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:00.464768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5654038a-5a2a-4512-86d1-3a0f6522e20d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.170914 Dec 16 18:02:00.465331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 480/938] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:00 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:01.158963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:01.159582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:01.166494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.166974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.167788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.168225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.326118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:01.334907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-10340707-06f5-4ad3-9372-925a16a52b66 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.179775 Dec 16 18:02:01.335512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 459/939] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:01 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:01.384043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:01.384887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:01.393196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.393639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.394437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.394892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.483491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:01.484114 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:01.490352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.490849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.491755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:01.492193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:01.549132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:01.563608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d5820df0-95fe-4f36-accf-23155e304e82 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.185003 Dec 16 18:02:01.563608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 481/940] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:01 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:01.642171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:01.651252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:01.652761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:01.653942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6fee457a-2cd9-49cb-b248-c1abdd3827c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.174228 Dec 16 18:02:01.654521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 460/941] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:01 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:02.353352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:02.354145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:02.360805 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.361375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.362266 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.362767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.500483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:02.510083 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0f7ceee3-8f6c-4c8e-912e-fa8106edd07a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.160520 Dec 16 18:02:02.511076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 482/942] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:02 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:02.580695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:02.581319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:02.588006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.588468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.589625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.590065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.672566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:02.673347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:02.679355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.679797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.680583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:02.681012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:02.739289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:02.750466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6c467511-9fd6-4355-93e1-3f2f53adeb79 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.170344 Dec 16 18:02:02.750466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 461/943] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:02 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:02.841799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:02.849857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:02.851562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:02.852712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3b11951e-0d44-45af-8e00-662bfd931942 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.184027 Dec 16 18:02:02.853332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 483/944] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:02 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:03.527459 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:03.528067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:03.534108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.534585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.535380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.535811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.692225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:03.700753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4a5cbd8b-50f7-4fa2-8c9c-e825cc2054b5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.176968 Dec 16 18:02:03.701316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 462/945] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:03 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:03.765000 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:03.765960 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:03.783367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.784105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.785287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.785929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.872493 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:03.873109 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:03.881621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.882548 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.883928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:03.884630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:03.945956 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:03.953842 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4bc0c7ca-861a-48c3-8079-37d4da1a542b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.192467 Dec 16 18:02:03.954418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 484/946] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:03 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:04.051972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:04.063285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:04.064760 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:04.066037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1b06c9cb-ff24-471f-8a9d-ad83d36bccc9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.197736 Dec 16 18:02:04.066605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 463/947] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:03 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:04.719860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:04.721048 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:04.728608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:04.730315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:04.731557 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:04.732014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:04.894417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:04.906726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2b9f5407-528b-494f-9ec4-9e0b2a9ec65d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.190490 Dec 16 18:02:04.907727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 485/948] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:04 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:04.975411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:04.976241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:04.983172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:04.983792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:04.984706 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:04.985293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:05.085513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:05.086130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:05.092749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:05.093194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:05.093952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:05.094381 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:05.120999 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:05.130060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ffce5558-59f3-417d-b799-68dcb20406fb tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.161405 Dec 16 18:02:05.134557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 464/949] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:04 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:05.231350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:05.239688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:05.241291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:05.242489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d39e7a8f-ed14-482b-98a5-1b9e1b1692c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.161012 Dec 16 18:02:05.243486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 486/950] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:05 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:05.925901 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:05.926508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:05.933826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:05.934273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:05.935091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:05.935525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:06.077938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:06.086143 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-97f615f8-0a88-41a6-a558-2de35508e441 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.163943 Dec 16 18:02:06.086741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 465/951] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:05 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:06.148744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:06.149363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:06.156491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:06.156939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:06.157715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:06.158146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:06.298356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:06.308056 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bb7048cc-c052-4baa-a50d-6b06971fb7ed tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.163814 Dec 16 18:02:06.308635 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 487/952] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:06 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:06.379305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:06.379917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:06.387078 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:06.387525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:06.388333 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:06.388764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:06.526282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:06.538013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:06.539284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:06.540448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f80f54ec-597c-4c38-a3f5-71871d01aafc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.282943 Dec 16 18:02:06.541051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 466/953] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:06 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:07.103902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:07.104518 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:07.110673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.111125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.111905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.112344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.248031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:07.256792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aa8197ce-2187-489c-b36b-7b7ce09d4d99 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.156654 Dec 16 18:02:07.257364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 488/954] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:07 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:07.324876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:07.325426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:07.332329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.332776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.333591 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.334670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.476613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:07.484335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a136dafd-65bd-497e-8d4a-006a18fae6bd tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.163417 Dec 16 18:02:07.484936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 467/955] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:07 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:07.558878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:07.559502 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:07.565886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.566335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.567169 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:07.567602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:07.705562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:07.714524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:07.716059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:07.717224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a09b3369-da22-422e-97dd-e6d097f8e997 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.162353 Dec 16 18:02:07.717791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 489/956] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:07 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:08.273415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:08.274023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:08.280805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.281246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.282023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.282448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.424328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:08.433292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-49ef9f81-c1a9-48ef-988c-747d93f0c28a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1677 microversion: 2.1 time: 0.163599 Dec 16 18:02:08.433840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 468/957] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:08 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:08.504193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:08.504792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:08.511803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.512250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.513034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.513513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.672368 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:08.682100 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-07b094ad-668a-433f-99bc-1f2dbbf53840 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.182779 Dec 16 18:02:08.682678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 490/958] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:08 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:08.735437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:08.736054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:08.744119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.744563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.745371 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:08.745801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:08.893362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:08.901970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:08.903495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:08.904663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ebd9acb7-24dc-46a3-9c8c-930c5168a3b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1740 microversion: 2.20 time: 0.173134 Dec 16 18:02:08.905253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 469/959] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:08 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:09.450393 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:09.451320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:09.457943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.458575 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.459463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.459898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.702016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:09.703103 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:09.709606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:09.712515 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.713037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.713937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.714743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.721664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-36d537c2-aa26-4d92-9863-a5bdf63a0014 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1654 microversion: 2.1 time: 0.274043 Dec 16 18:02:09.723696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 491/960] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:09 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1654 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:09.739338 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d5d272a1-e387-406e-80f8-f5648ac40ffa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:09.746550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d272a1-e387-406e-80f8-f5648ac40ffa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.747433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d272a1-e387-406e-80f8-f5648ac40ffa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.775876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d5d272a1-e387-406e-80f8-f5648ac40ffa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Going to try to start instance {{(pid=115914) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 16 18:02:09.834714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d5d272a1-e387-406e-80f8-f5648ac40ffa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action" status: 202 len: 0 microversion: 2.1 time: 0.098516 Dec 16 18:02:09.836307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 492/961] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:02:09 2021] POST /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:02:09.846120 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:09.847483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:09.857511 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.858401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:09.860339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:09.861607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:10.123011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:10.132108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-80721f8b-a270-4daa-b671-3f46094809fa tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1663 microversion: 2.1 time: 0.290514 Dec 16 18:02:10.141236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 493/962] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:09 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1663 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:10.200184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-11112069-9904-49ea-8131-2bc9fac2bcfe req-13884c94-4cee-4bca-bb51-178154061a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:10.201773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:10.201773 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:02:10.209212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-11112069-9904-49ea-8131-2bc9fac2bcfe req-13884c94-4cee-4bca-bb51-178154061a47 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:10.210149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-11112069-9904-49ea-8131-2bc9fac2bcfe req-13884c94-4cee-4bca-bb51-178154061a47 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:10.221796 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-11112069-9904-49ea-8131-2bc9fac2bcfe req-13884c94-4cee-4bca-bb51-178154061a47 service nova] Creating event network-changed:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:02:10.228527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-11112069-9904-49ea-8131-2bc9fac2bcfe req-13884c94-4cee-4bca-bb51-178154061a47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093808 Dec 16 18:02:10.229147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 494/963] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:10.234471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:10.235223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:10.241820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:10.242270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:10.243069 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:10.243564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:10.251387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:10.268303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c139a401-fe67-405c-83f7-66cad43a8e85 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.571402 Dec 16 18:02:10.278273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 470/964] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:09 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:10.470545 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:10.479846 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:10.482483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:10.483725 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d8619a73-5b9b-4398-8594-41d5effe6bc5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1722 microversion: 2.20 time: 0.253485 Dec 16 18:02:10.484292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 495/965] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:10 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:11.150805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:11.151421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:11.158246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.158715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.159508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.159974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.291922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:11.292676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:11.299275 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.299718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.300535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.300981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.304667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:11.313533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f53d6808-2bae-4a5e-8bb1-54bb33056c5a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1663 microversion: 2.1 time: 0.166494 Dec 16 18:02:11.314120 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 471/966] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:11 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:11.454175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:11.463887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fade98b3-3398-4ed5-9a76-9cabbd2aa238 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.175679 Dec 16 18:02:11.464753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 496/967] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:11 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:11.504446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:11.505101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:11.514053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.514661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.515812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:11.516400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:11.660764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:11.669541 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:11.671087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:11.672726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ea7ea5f2-879d-4436-8a78-2424fd5170f9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1722 microversion: 2.20 time: 0.174486 Dec 16 18:02:11.673617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 472/968] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:11 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:12.332297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:12.333104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:12.340504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.340948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.341705 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.342160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.481561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:12.482160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:12.488299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.488700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.489685 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.490273 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.492010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:12.500710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-597f0f54-ba8a-4c4c-a49c-9416e06848fc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1667 microversion: 2.1 time: 0.172125 Dec 16 18:02:12.501504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 497/969] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:12 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:12.631687 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:12.640174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2ffe0724-868e-47c6-b18f-857ce6649d15 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.163064 Dec 16 18:02:12.640798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 473/970] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:12 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:12.696505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:12.697121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:12.703426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.703918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.704706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.705139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.848574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:12.857246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:12.858795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:12.859984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-97815a9e-5e7a-47e5-959d-386437ca3fe7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1725 microversion: 2.20 time: 0.168190 Dec 16 18:02:12.860673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 498/971] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:12 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:12.878255 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4e80750-de2a-4d6c-a235-fe035300580e"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:12.879624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:12.887155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.887621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:12.888702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:12.888977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.207106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-288f2404-c4a5-45f2-bb0b-06025fa88e03 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332494 Dec 16 18:02:13.207819 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 474/972] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Dec 16 18:02:12 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:02:13.321042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:13.321614 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:13.327838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.328286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.329068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.329501 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.424709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7c71574e-375b-4780-b6c2-6baabd14344a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action" status: 202 len: 0 microversion: 2.20 time: 0.107453 Dec 16 18:02:13.428333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 499/973] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:02:13 2021] POST /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:02:13.433711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:13.434377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:13.441690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.442251 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.443080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.443627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.597994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:13.607835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:13.609396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:13.610710 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f8cf30a1-2769-4a00-a8f7-d6a3c2925ba6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1751 microversion: 2.20 time: 0.180803 Dec 16 18:02:13.611268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 475/974] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:13 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:13.657171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:13.657885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:13.664447 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.664906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.665715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:13.666169 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:13.842374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:13.853259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-08017446-210e-4ee5-a1f7-07fb0b2382f9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.199564 Dec 16 18:02:13.854263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 500/975] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:13 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:14.629646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:14.630367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:14.638414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:14.638803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:14.639653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:14.640066 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:14.790889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:14.800310 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:14.802551 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:14.803970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ccc524b8-d170-4e71-a9fb-ddc3a3cea863 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1753 microversion: 2.20 time: 0.178610 Dec 16 18:02:14.804542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 476/976] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:14 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:14.877781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:14.879067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:14.890780 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:14.891221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:14.892225 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:14.892655 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:15.037544 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:15.045495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c5c39888-77eb-4e9d-bb0d-87594a37eab3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.177802 Dec 16 18:02:15.046116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 501/977] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:14 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:15.827617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:15.828284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:15.835438 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:15.835905 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:15.836834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:15.837416 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:15.997917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:16.008602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:16.010422 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:16.012054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-70689a1d-c9fe-488d-8077-7eebfaf4d780 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.188195 Dec 16 18:02:16.012771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 477/978] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:15 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:16.062197 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:16.062828 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:16.069704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:16.070193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:16.071474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:16.072236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:16.223044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:16.232400 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7ad5fee6-0548-401d-99f2-1d01cc08a11c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.173858 Dec 16 18:02:16.233090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 502/979] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:16 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:16.854059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-2c2158ab-7215-466d-876f-bd891db64704 req-03015020-a9dd-437b-bf35-0a87e1b90956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "name": "network-vif-plugged", "status": "completed", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:16.856053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:16.856053 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:02:16.866264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-2c2158ab-7215-466d-876f-bd891db64704 req-03015020-a9dd-437b-bf35-0a87e1b90956 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:16.867016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-2c2158ab-7215-466d-876f-bd891db64704 req-03015020-a9dd-437b-bf35-0a87e1b90956 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:16.902457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-2c2158ab-7215-466d-876f-bd891db64704 req-03015020-a9dd-437b-bf35-0a87e1b90956 service nova] Creating event network-vif-plugged:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:02:16.909000 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-2c2158ab-7215-466d-876f-bd891db64704 req-03015020-a9dd-437b-bf35-0a87e1b90956 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060071 Dec 16 18:02:16.909718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 478/980] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:17.030795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:17.031489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:17.038653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:17.039214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:17.040182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:17.040615 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:17.205180 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:17.215570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:17.217051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:17.218209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d36777bc-bb4f-404f-8750-5306732cdea3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.191342 Dec 16 18:02:17.218797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 503/981] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:17 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:17.251307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:17.252479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:17.260299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:17.260740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:17.261534 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:17.261995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:17.409892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:17.420156 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9ce0ebf2-5531-4894-bb4e-5bb457dacd65 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.173892 Dec 16 18:02:17.420757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 479/982] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:17 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:18.238258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:18.238965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:18.247540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:18.247983 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:18.248839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:18.249229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:18.426060 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:18.439957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:18.440430 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:18.441694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:18.448110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:18.448688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:18.449329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:18.450293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:18.450967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8d813c09-b4a5-4b61-abf7-f7c4427fc5c1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.216859 Dec 16 18:02:18.451248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:18.452153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 504/983] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:18 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:18.615343 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:18.624013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4d6d7b6e-8a5f-484b-8d9a-87ade5e42613 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.187551 Dec 16 18:02:18.625202 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 480/984] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:18 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:19.469748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:19.470413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:19.476973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:19.477426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:19.478219 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:19.478732 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:19.641416 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:19.642081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:19.650960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:19.651662 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:19.652869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:19.653513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:19.806149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:19.810178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:19.814884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b86bb6d1-8576-4bc3-b692-b0d5c2d6e301 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.177182 Dec 16 18:02:19.826295 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 481/985] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:19 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:19.830392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:19.831910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:19.833105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-99f68e55-5110-4eef-b334-f6400de3884a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.367216 Dec 16 18:02:19.833912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 505/986] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:19 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:20.835877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:20.837552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:20.843851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:20.844299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:20.846605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:20.846605 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:20.854667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:20.856016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:20.867512 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:20.868382 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:20.869794 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:20.870660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:21.012961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:21.022479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-26192405-efd4-46ee-807d-7c5da7237a47 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.190875 Dec 16 18:02:21.023275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 482/987] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:20 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:21.066014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:21.082031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:21.084839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:21.087002 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-edb8bf12-1598-4a25-afb2-23842061dcb8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.238291 Dec 16 18:02:21.094445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 506/988] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:20 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:22.040069 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:22.040650 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:22.047598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:22.048044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:22.048835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:22.049264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:22.110370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:22.111136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:22.118383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:22.118874 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:22.119726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:22.120168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:22.201961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:22.210535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9703b1aa-76bf-48ee-b439-00bd86001c1c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.174598 Dec 16 18:02:22.213239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 483/989] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:22 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:22.274474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:22.282920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:22.284399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:22.285630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2cfc7185-f89d-4036-8826-758c46ee86bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.179245 Dec 16 18:02:22.286190 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 507/990] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:22 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:23.230476 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:23.231103 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:23.237615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:23.238052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:23.238896 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:23.239320 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:23.308383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:23.308383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:23.320881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:23.320881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:23.321583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:23.323632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:23.420039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:23.428742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-45245894-d387-40e1-834f-bf639e240508 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.203006 Dec 16 18:02:23.435787 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 484/991] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:23 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:23.512289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:23.520692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:23.522162 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:23.523409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-79b77439-547f-473a-b75e-880ab5bcaa2d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.222408 Dec 16 18:02:23.524118 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 508/992] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:23 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:24.447620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:24.449433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:24.456795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:24.457859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:24.459218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:24.459893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:24.543211 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:24.543887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:24.550528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:24.551013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:24.551793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:24.552258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:24.611389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:24.627752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9aacfef7-e4cb-414a-8411-3c6cb8bf45a5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.184304 Dec 16 18:02:24.651008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 485/993] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:24 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:24.709419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:24.718287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:24.719789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:24.720942 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-476c5089-7986-4d9c-a98c-bd852650e0bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.181604 Dec 16 18:02:24.721492 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 509/994] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:24 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:25.647181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:25.649389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:25.657779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:25.658194 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:25.659233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:25.659655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:25.752813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:25.753426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:25.761095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:25.761535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:25.762334 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:25.762932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:25.821257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:25.829402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c0ad22fa-4dbb-487a-ace5-3bf02d42f13a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.187654 Dec 16 18:02:25.829991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 486/995] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:25 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:25.908700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:25.918355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:25.920080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:25.921520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-52d0d143-4814-422a-8e4f-18523cf3f045 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.178970 Dec 16 18:02:25.922806 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 510/996] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:25 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:26.846132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:26.846822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:26.854317 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:26.854894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:26.855696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:26.856102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:26.940136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:26.940815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:26.948030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:26.948486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:26.949284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:26.949720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:27.008494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:27.017772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7a3c1211-6d35-4f21-822f-7d6ee96f7058 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.175630 Dec 16 18:02:27.018481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 487/997] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:26 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:27.092880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:27.106121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:27.108572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:27.110320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-48c0fed4-174d-4540-842a-cc8158829e67 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.174741 Dec 16 18:02:27.111215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 511/998] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:26 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:28.038373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:28.039182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:28.049086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:28.049571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:28.050405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:28.050889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:28.130166 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:28.130930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:28.139305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:28.139746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:28.140537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:28.141020 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:28.205154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:28.213369 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-696e0544-4bc9-4072-a852-329be73ab75b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.180885 Dec 16 18:02:28.214738 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 488/999] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:28 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:28.294317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:28.303171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:28.304667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:28.305862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4b43b08f-5a04-40a7-848b-3d4b1981dd76 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.180342 Dec 16 18:02:28.306429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 512/1000] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:28 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:02:29.231620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:29.232227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:29.241634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:29.242382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:29.243576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:29.244118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:29.324526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:29.325126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:29.331910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:29.332425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:29.333206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:29.333631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:29.396237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:29.404951 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e59bb4bc-dcb2-443d-a799-7f5c9de99c46 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.177171 Dec 16 18:02:29.405547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 489/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:29 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:29.490430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:29.500483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:29.501990 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:29.503230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5028d5f2-3873-4483-b4c3-eac854cb82a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.182482 Dec 16 18:02:29.503792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 513/1002] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:29 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:30.421962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:30.422581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:30.429654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:30.430097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:30.430914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:30.431335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:30.521887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:30.522920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:30.530367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:30.530984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:30.531925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:30.532275 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:30.571725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:30.579741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a00b5351-e8b0-4b5b-ac9e-4cef287df5ad tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1356 microversion: 2.1 time: 0.161563 Dec 16 18:02:30.580367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 490/1003] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:30 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:30.720819 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:30.729799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:30.733328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:30.733328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8309fe72-4af8-49d8-ba9d-f5b6a8024a20 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.214992 Dec 16 18:02:30.733328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 514/1004] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:30 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:31.597226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:31.597844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:31.604501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.605589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.606544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.607131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.741720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.750543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7da3a143-0a09-486e-8b8b-15f6ef010972 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1546 microversion: 2.1 time: 0.156931 Dec 16 18:02:31.751131 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:31.751619 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 491/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:31 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:31.751859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:31.759102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.759546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.760380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.760866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.767061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:31.768620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:31.775704 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.776331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.777173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.777603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.904796 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.913167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.914008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.914643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.915820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bf32cd54-0362-424a-8de1-ac81a6473847 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.168597 Dec 16 18:02:31.916377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 515/1006] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:31 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:31.921877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-45cf04af-8be3-4f6c-86eb-a16f23b8af5e tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1546 microversion: 2.1 time: 0.158537 Dec 16 18:02:31.922524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 492/1007] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:31 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:31.937332 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:31.940912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:31.940912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:02:31.941836 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:31.942568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Searching by: {'deleted': False, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb'} {{(pid=115914) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 16 18:02:31.949484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.949924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:31.950750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:31.951182 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:32.044030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.multi_cell_list [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115914) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 16 18:02:32.141708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b9cc1f99-afda-4ae5-b4f0-6f8fc9ae8cee tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.207860 Dec 16 18:02:32.142285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 516/1008] 10.222.0.32 () {58 vars in 1124 bytes} [Thu Dec 16 18:02:31 2021] GET /compute/v2.1/servers => generated 341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:32.152855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:32.153460 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:32.159795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:32.160231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:32.161008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:32.161433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:32.302939 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:32.311133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-98e34793-c261-4379-ba87-042baad47988 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1546 microversion: 2.1 time: 0.161938 Dec 16 18:02:32.311728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 493/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:32 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:32.934696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:32.935327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:32.942670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:32.943207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:32.944651 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:32.945438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.086014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:33.096297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:33.097812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:33.099030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-47f1f8bf-a69c-4037-b4f4-a7884781e505 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.168365 Dec 16 18:02:33.099595 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 517/1010] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:32 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:33.517277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:33.517882 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:33.524087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.524521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.525297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.525714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.550366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lazy-loading 'flavor' on Instance uuid 99662dab-b8ee-47d0-bd2c-342104e005c4 {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:02:33.631842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f4099445-3f31-40ab-89ab-c24eb30d3534 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "POST /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4/action" status: 202 len: 0 microversion: 2.1 time: 0.236009 Dec 16 18:02:33.632457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 494/1011] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:02:33 2021] POST /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:02:33.641672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:33.642358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:33.650137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.650783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.651937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.653190 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.807075 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:33.820102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5b6d7f62-e638-440d-b7c1-9e1bf2dc1ec3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.182070 Dec 16 18:02:33.820690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 518/1012] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:33 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:33.903973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3da39074-a8ef-441b-8ac8-c831ff350f48"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:33.905097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:33.911558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.912006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:33.912791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:33.913221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:34.118257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:34.119003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:34.125589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:34.126041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:34.126860 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:34.127297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:34.173727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-909221fc-7166-4f17-92f4-e263082eeda3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274384 Dec 16 18:02:34.174291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 495/1013] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 18:02:33 2021] POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:34.513583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:34.526080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:34.527761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:34.528918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-413a5431-c2fc-4e31-a978-e043e81fdc09 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.415529 Dec 16 18:02:34.529491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 519/1014] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:34 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:34.842099 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:34.842838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:34.849367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:34.849812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:34.850572 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:34.851023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:35.012644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:35.020661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-79a77512-db19-4984-b2f6-7dbff556b150 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.183452 Dec 16 18:02:35.021209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 496/1015] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:34 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:35.551839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:35.552424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:35.560175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:35.560639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:35.561453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:35.561902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:35.710765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:35.724377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:35.726688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:35.728470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ae7f07fc-c9db-4252-b443-173cadfd7d88 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.180417 Dec 16 18:02:35.729208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 520/1016] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:35 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:36.043088 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:36.044174 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:36.054954 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:36.055687 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:36.056973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:36.057727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:36.204065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:36.216587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-addf1328-264d-477f-af02-e4a07026506b tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.179410 Dec 16 18:02:36.217196 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 497/1017] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:36 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:36.749235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:36.749859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:36.756984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:36.757437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:36.758245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:36.758704 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:36.899916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:36.908870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:36.910356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:36.911536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-20195ec2-75f1-4637-9c7e-d224ae8f4fc4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.166890 Dec 16 18:02:36.912073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 521/1018] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:36 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:37.242598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:37.243535 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:37.254842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:37.255521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:37.256793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:37.257516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:37.402144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:37.410312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e0f21d7f-dad4-4870-a161-ad3bd5148015 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.173976 Dec 16 18:02:37.410919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 498/1019] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:37 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:37.933003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:37.933914 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:37.944795 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:37.945558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:37.946957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:37.947695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:38.090015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:38.099460 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:38.100926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:38.102060 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-16f69cd1-d671-447d-969c-7fac67dab4a6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.175488 Dec 16 18:02:38.102585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 522/1020] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:37 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:38.431188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:38.432205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:38.440806 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:38.441994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:38.442157 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:38.442491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:38.594225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:38.602057 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6e61b499-2601-441c-9fd0-6b161b738e1f tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.177067 Dec 16 18:02:38.602652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 499/1021] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:38 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:39.125966 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:39.126603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:39.133590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:39.134036 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:39.134876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:39.135301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:39.276730 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:39.285826 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:39.287371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:39.288536 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-103a678a-e25a-4a30-af38-b06a17cb44b0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.166848 Dec 16 18:02:39.289099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 523/1022] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:39 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:39.619814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:39.620426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:39.627598 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:39.628050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:39.628844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:39.629304 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:39.786037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:39.794162 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5948e892-eb9c-442a-b86e-9e6ff5b0a858 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.178101 Dec 16 18:02:39.794979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 500/1023] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:39 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:40.311901 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:40.313039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:40.322644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:40.323409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:40.324692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:40.325361 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:40.483899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:40.492832 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:40.494347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:40.495537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-48c29227-7686-4225-b042-ae9f39b198bc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.190914 Dec 16 18:02:40.496082 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 524/1024] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:40 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:40.812312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:40.813085 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:40.819899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:40.820280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:40.821082 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:40.821506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.000254 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:41.007964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-669908a6-11b6-4c9d-8c93-04abc931b552 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.199607 Dec 16 18:02:41.008546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 501/1025] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:40 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:41.024489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-bb1d1a84-5a8c-4939-8056-f24c58eb9f38 req-c3ac4d3c-ba66-4766-8643-3df079d2b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "name": "network-vif-plugged", "status": "completed", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:41.026678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:41.026678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:02:41.036058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-bb1d1a84-5a8c-4939-8056-f24c58eb9f38 req-c3ac4d3c-ba66-4766-8643-3df079d2b1d7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:41.036562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-bb1d1a84-5a8c-4939-8056-f24c58eb9f38 req-c3ac4d3c-ba66-4766-8643-3df079d2b1d7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.049477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-bb1d1a84-5a8c-4939-8056-f24c58eb9f38 req-c3ac4d3c-ba66-4766-8643-3df079d2b1d7 service nova] Creating event network-vif-plugged:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 18:02:41.054651 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-bb1d1a84-5a8c-4939-8056-f24c58eb9f38 req-c3ac4d3c-ba66-4766-8643-3df079d2b1d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035557 Dec 16 18:02:41.055451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 525/1026] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:41.514689 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:41.515582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:41.522407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:41.522948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.523735 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:41.524155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.672228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:41.680553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:41.682086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:41.683290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0dab9782-8d97-4f03-8c24-1e046fa99e8f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.172386 Dec 16 18:02:41.683866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 502/1027] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:41 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:41.741729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:41.742420 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:41.749130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:41.750305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.751756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:41.752194 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:41.894357 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:41.902405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4e0d8b0f-0785-41d9-8906-c4fe7a5221cf tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1592 microversion: 2.1 time: 0.165423 Dec 16 18:02:41.903196 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 526/1028] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:41 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1592 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:42.024322 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:42.025182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:42.031866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:42.032419 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:42.033270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:42.033698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:42.221930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:42.231326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-86ce0560-3b3d-483b-829f-75b05396761a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.210671 Dec 16 18:02:42.232045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 503/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:42 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:42.701485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:42.702114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:42.708696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:42.709138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:42.709923 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:42.710352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:42.844420 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:42.853086 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:42.854565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:42.855746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3db64ec7-3613-4093-8d7a-f7e6c735957e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.158095 Dec 16 18:02:42.856441 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 527/1030] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:42 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:43.250063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:43.251423 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:43.258276 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:43.258738 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:43.259701 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:43.260309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:43.507107 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:43.516035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-86b15dae-320a-4e3e-afd9-521fa229cd1a tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.270233 Dec 16 18:02:43.516707 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 504/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:43 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:43.873790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:43.874493 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:43.890348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:43.890821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:43.891858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:43.892290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:44.145214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:44.155463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:44.157794 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:44.159410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a332251f-cfb0-4b74-bd8c-fbfa598c8cc2 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1809 microversion: 2.20 time: 0.289737 Dec 16 18:02:44.171637 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 528/1032] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:43 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:44.211178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-c35fa3b6-6f4b-46c7-b760-ec43c9232d8f req-c711d386-1a22-420f-ba50-a9ab10964fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:44.212981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:44.212981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:02:44.220835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-c35fa3b6-6f4b-46c7-b760-ec43c9232d8f req-c711d386-1a22-420f-ba50-a9ab10964fa1 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:44.221267 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-c35fa3b6-6f4b-46c7-b760-ec43c9232d8f req-c711d386-1a22-420f-ba50-a9ab10964fa1 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:44.233211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-c35fa3b6-6f4b-46c7-b760-ec43c9232d8f req-c711d386-1a22-420f-ba50-a9ab10964fa1 service nova] Creating event network-changed:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:02:44.239674 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-c35fa3b6-6f4b-46c7-b760-ec43c9232d8f req-c711d386-1a22-420f-ba50-a9ab10964fa1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113662 Dec 16 18:02:44.240374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 505/1033] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:02:44.533307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:44.534361 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:44.540777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:44.541565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:44.542675 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:44.543349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:44.816264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:44.828279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ff8da946-cee3-4231-a5ae-de70251e0e93 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.298971 Dec 16 18:02:44.829546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 529/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:44 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:45.179461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:45.180989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:45.188302 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.189122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.190153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.190872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.413987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:45.426434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:45.428253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:45.429731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e57b429d-5581-4717-9597-4321ad01ac86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1796 microversion: 2.20 time: 0.254553 Dec 16 18:02:45.430396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 506/1035] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:02:45 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1796 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:02:45.561076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1735733232"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:45.561634 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:45.568682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.569136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.569927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.570355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.731391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.network.security_group_api [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Adding security group 95fcd07d-2750-4e67-8850-8076191f9ed0 to port 247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 Dec 16 18:02:45.845968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:45.847298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:45.853482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.853933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.854773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:45.855192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:45.994179 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:46.002083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e5fcfc44-cbbc-48ad-a079-c3c4a83964b4 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.159998 Dec 16 18:02:46.002688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 507/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:45 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:46.093690 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-68aff752-3734-4e1e-8d10-d52b6f18c55b tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action" status: 202 len: 0 microversion: 2.1 time: 0.536371 Dec 16 18:02:46.094331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 530/1037] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:02:45 2021] POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:02:46.103377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:46.103996 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:46.112169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-6aa8abbb-1658-42d0-99a5-c6dbef2e649c req-005b1ccd-3bc6-41e5-9fe6-4ec25abcfd30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:46.113743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:46.113743 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:02:46.133870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:46.134599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:46.135744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:46.136253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:46.142826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-6aa8abbb-1658-42d0-99a5-c6dbef2e649c req-005b1ccd-3bc6-41e5-9fe6-4ec25abcfd30 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:46.143578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-6aa8abbb-1658-42d0-99a5-c6dbef2e649c req-005b1ccd-3bc6-41e5-9fe6-4ec25abcfd30 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:46.158770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-6aa8abbb-1658-42d0-99a5-c6dbef2e649c req-005b1ccd-3bc6-41e5-9fe6-4ec25abcfd30 service nova] Creating event network-changed:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:02:46.164281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-6aa8abbb-1658-42d0-99a5-c6dbef2e649c req-005b1ccd-3bc6-41e5-9fe6-4ec25abcfd30 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056162 Dec 16 18:02:46.166497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 508/1038] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:46.314061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:46.322281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-46112084-6c9d-4b66-8621-c0aa6855afc9 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1758 microversion: 2.1 time: 0.223662 Dec 16 18:02:46.335096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 531/1039] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:46 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:47.021256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:47.021810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:47.031097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.031705 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.032621 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.033170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.184808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:47.193525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4360872f-a243-4852-a474-54a4feb99636 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1566 microversion: 2.1 time: 0.177457 Dec 16 18:02:47.194277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 509/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:47 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:47.211379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:47.212041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:47.218994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.219437 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.220558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.221969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.302928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-eba37de6-ff0d-496a-9dc6-4fa2dc431d6e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "POST /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4/action" status: 202 len: 0 microversion: 2.1 time: 0.095680 Dec 16 18:02:47.303448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 532/1041] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:02:47 2021] POST /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:02:47.311324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:47.311928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:47.318481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.318960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.319729 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:47.320177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:47.468963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:47.477243 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3e151d40-05ea-4bc2-9635-82aa79837fdf tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1514 microversion: 2.1 time: 0.169489 Dec 16 18:02:47.477846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 510/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:47 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:48.495866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:48.496484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:48.503003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:48.503467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:48.504279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:48.504721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:48.648876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:48.656593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a6b9e344-d873-4392-a3cd-93dfd76ffe20 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1516 microversion: 2.1 time: 0.164992 Dec 16 18:02:48.657164 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 533/1043] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:48 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:49.677189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:49.677813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:49.684785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:49.685228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:49.686017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:49.686455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:49.833531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:49.847084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6de265d4-497d-49b9-8dea-3f13dc04f02d tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.173942 Dec 16 18:02:49.847813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 511/1044] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:49 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:50.868955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:50.869872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:50.879645 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:50.880097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:50.880929 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:50.881365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:51.016992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-7722a29f-7a43-41a3-8523-439c26dea053 req-af379438-3976-4808-8c50-5d2c7d3db5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "name": "network-vif-unplugged", "status": "completed", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:02:51.018840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:02:51.018840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:02:51.027828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-7722a29f-7a43-41a3-8523-439c26dea053 req-af379438-3976-4808-8c50-5d2c7d3db5e5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:51.028341 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-7722a29f-7a43-41a3-8523-439c26dea053 req-af379438-3976-4808-8c50-5d2c7d3db5e5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:51.031138 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:51.041786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d19ae9dc-6813-402f-ad37-31472f77b692 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.179099 Dec 16 18:02:51.042336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 534/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:50 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:51.042474 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-7722a29f-7a43-41a3-8523-439c26dea053 req-af379438-3976-4808-8c50-5d2c7d3db5e5 service nova] Creating event network-vif-unplugged:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 18:02:51.047703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-7722a29f-7a43-41a3-8523-439c26dea053 req-af379438-3976-4808-8c50-5d2c7d3db5e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034778 Dec 16 18:02:51.048382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 512/1046] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:02:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:02:52.061928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:52.062733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:52.072581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:52.073228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:52.074374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:52.075037 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:52.235408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:52.243778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0e2819b0-f5ac-4739-9cba-42d853ca3dca tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.187329 Dec 16 18:02:52.244347 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 535/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:52 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:53.265865 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:53.266732 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:53.273522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:53.273968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:53.274785 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:53.275210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:53.432061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:53.440126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c8449027-d9df-4e7e-824c-fa5965bc5090 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.178828 Dec 16 18:02:53.441673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 513/1048] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:53 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:54.460371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:54.461021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:54.468321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:54.468747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:54.469540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:54.469970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:54.628939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:54.636697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8ed1bd0c-365d-4232-9215-72bf9e751902 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.180282 Dec 16 18:02:54.637271 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 536/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:54 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:02:55.653354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:55.653975 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:55.661163 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:55.661615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:55.662420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:55.663006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:55.801183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:55.809707 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2991373b-08b6-4236-b55f-92c156dbf11e tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.160056 Dec 16 18:02:55.810319 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 514/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:55 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:56.827703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:56.829078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:56.837471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:56.837911 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:56.839104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:56.839553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:56.985767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:56.994206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-26ab7fcf-796c-4cb6-b3b0-d252eef70bc3 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.170559 Dec 16 18:02:56.995366 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 537/1051] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:56 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:58.011987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:58.012590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:58.019522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:58.019990 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:58.020750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:58.021206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:58.159019 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:58.166976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d3dd94d6-5dee-44ad-ac3b-f23c7ec024ce tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1572 microversion: 2.1 time: 0.158857 Dec 16 18:02:58.167530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 515/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:58 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:02:59.185791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:02:59.186379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:02:59.194198 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:59.194715 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:59.195494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:02:59.195922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:02:59.345819 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:02:59.354005 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e82e455f-dd2b-49da-92a6-954f09894800 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1559 microversion: 2.1 time: 0.173873 Dec 16 18:02:59.354578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 538/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:02:59 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:01.081616 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-3c657460-405f-4f23-8a07-f0c2a07a8295 req-c17f1ce7-5024-479c-bf68-9c5f38752e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "name": "network-vif-plugged", "status": "completed", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:01.083190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:01.083190 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:03:01.092895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3c657460-405f-4f23-8a07-f0c2a07a8295 req-c17f1ce7-5024-479c-bf68-9c5f38752e9a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:01.093351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3c657460-405f-4f23-8a07-f0c2a07a8295 req-c17f1ce7-5024-479c-bf68-9c5f38752e9a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:01.105303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-3c657460-405f-4f23-8a07-f0c2a07a8295 req-c17f1ce7-5024-479c-bf68-9c5f38752e9a service nova] Creating event network-vif-plugged:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 18:03:01.110766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-3c657460-405f-4f23-8a07-f0c2a07a8295 req-c17f1ce7-5024-479c-bf68-9c5f38752e9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Dec 16 18:03:01.111348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 516/1054] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:11.774238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:11.775257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:11.781995 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:11.782436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:11.783222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:11.783724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:11.814222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-876674da-340a-486a-8600-e1285188f8a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043826 Dec 16 18:03:11.815029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 539/1055] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:03:11 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:11.874977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:11.875587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:11.882271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:11.882733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:11.883509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:11.883933 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:11.908271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:03:11.989062 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-39e69605-6b1d-4cc1-a704-569492783fce tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 204 len: 0 microversion: 2.1 time: 0.118109 Dec 16 18:03:11.989880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 517/1056] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:03:11 2021] DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:03:11.998831 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:11.999449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:12.005485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:12.005928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:12.006723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:12.007222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:12.157077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:12.165480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3a40f0ea-1f8d-48e7-9030-da313be73461 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1673 microversion: 2.1 time: 0.170836 Dec 16 18:03:12.166087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 540/1057] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:11 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:13.183418 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:13.184098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:13.191166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:13.191604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:13.192591 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:13.193016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:13.345725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:13.355401 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-aba5fa61-641f-45fb-9d2f-e8d46e894ceb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1673 microversion: 2.1 time: 0.176408 Dec 16 18:03:13.356013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 518/1058] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:13 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:14.372554 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:14.373199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:14.380467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:14.380931 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:14.382646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:14.382646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:14.446305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:14.455192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c768bdfb-dfaf-45c7-81b4-d255265a5efb tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 200 len: 1605 microversion: 2.1 time: 0.086407 Dec 16 18:03:14.466695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 541/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:14 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:14.476150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-ea2a239a-8f92-4063-963b-b86976227458 req-8e884b49-b6ed-45f7-80a2-756febb21540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6bc622-be3a-4c87-90e5-80f6bf9f4d39", "name": "network-vif-deleted", "tag": "a7bb0c45-53de-4c29-97b7-aabce3e37a85"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:14.477808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:14.477808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:03:14.486532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-ea2a239a-8f92-4063-963b-b86976227458 req-8e884b49-b6ed-45f7-80a2-756febb21540 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:14.487862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-ea2a239a-8f92-4063-963b-b86976227458 req-8e884b49-b6ed-45f7-80a2-756febb21540 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:14.501508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-ea2a239a-8f92-4063-963b-b86976227458 req-8e884b49-b6ed-45f7-80a2-756febb21540 service nova] Creating event network-vif-deleted:a7bb0c45-53de-4c29-97b7-aabce3e37a85 for instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 on hv-cinder-81920 Dec 16 18:03:14.508513 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-ea2a239a-8f92-4063-963b-b86976227458 req-8e884b49-b6ed-45f7-80a2-756febb21540 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037077 Dec 16 18:03:14.509117 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 519/1060] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:15.475696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:15.476306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:15.483504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:15.484272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:15.485058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:15.485495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:15.501772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. Dec 16 18:03:15.502984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:03:15.503854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c3a1b8ce-0986-40a8-bd3f-e0b8f039d15f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 404 len: 111 microversion: 2.1 time: 0.032895 Dec 16 18:03:15.504400 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 542/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:15 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:03:15.515011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f7ecb024-1f3e-4e4b-aa6c-3e52aa27113d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '.version_select at 0x7fca17796310>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:15.537973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f7ecb024-1f3e-4e4b-aa6c-3e52aa27113d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258446672" status: 202 len: 0 microversion: 2.1 time: 0.027032 Dec 16 18:03:15.538771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 520/1062] 10.222.0.32 () {58 vars in 1220 bytes} [Thu Dec 16 18:03:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258446672 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:03:16.380760 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: .version_select at 0x7fca1c158550>, body: {"keypair": {"name": "tempest-keypair-1479435857"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:16.396033 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:03:16.401103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:03:16.806607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:03:16.811394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:03:16.830608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-70c76016-56a6-40b2-8093-c62c122be455 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.453775 Dec 16 18:03:16.831485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 543/1063] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Dec 16 18:03:16 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:18.201314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1248246910", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43f239ba-5297-4276-aa7c-a1261d7cfa70"}], "security_groups": [{"name": "tempest-securitygroup--1024055945"}], "key_name": "tempest-keypair-1479435857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:18.592192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] validate_networks() for [('43f239ba-5297-4276-aa7c-a1261d7cfa70', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:03:19.066813 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:03:19.067307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:03:19.067775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:03:19.068181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:03:19.068561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:03:19.079638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:19.080087 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:19.080982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:19.081517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:19.099024 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for project 27b338079c744874b26565ecd0d93596. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:03:19.103549 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Getting quotas for user 1c5ac7db630e4c49b74b92b067adc693 and project 27b338079c744874b26565ecd0d93596. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:03:19.115938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:03:19.118426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:03:19.167532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-617ee5e1-2b77-4207-b3cb-47a815479c53 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.971226 Dec 16 18:03:19.168200 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 521/1064] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 18:03:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 18:03:19.179292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1a8d3777-6d1b-4c99-bd3a-103994c09721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:19.179906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1a8d3777-6d1b-4c99-bd3a-103994c09721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:19.235938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1a8d3777-6d1b-4c99-bd3a-103994c09721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:19.243099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1a8d3777-6d1b-4c99-bd3a-103994c09721 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1238 microversion: 2.1 time: 0.068768 Dec 16 18:03:19.243709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 544/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:19 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:20.263070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:20.263839 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:20.273366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:20.273883 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:20.275026 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:20.275541 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:20.361854 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:20.372027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c6b4dc48-d783-440a-82fb-0d1fae0c06e3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1308 microversion: 2.1 time: 0.114303 Dec 16 18:03:20.372620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 522/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:20 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:21.388959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:21.389582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:21.397610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:21.398048 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:21.399125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:21.399641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:21.565282 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:21.574643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-199ebffb-f147-4f19-974c-5b3a58f8e185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.189334 Dec 16 18:03:21.575213 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 545/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:21 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:21.679351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-3dc1433a-4a8c-4d44-ab2f-5ae39456f455 req-f39f014d-d541-4781-b8c0-1036aa507cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1baf3ec0-6bf3-4ec7-93ce-46d3471c9984", "tag": "8d32b2ae-696c-4691-9736-3ca1147eff32"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:21.681962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:21.681962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:03:21.697607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3dc1433a-4a8c-4d44-ab2f-5ae39456f455 req-f39f014d-d541-4781-b8c0-1036aa507cfe service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:21.699162 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3dc1433a-4a8c-4d44-ab2f-5ae39456f455 req-f39f014d-d541-4781-b8c0-1036aa507cfe service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:21.714546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-3dc1433a-4a8c-4d44-ab2f-5ae39456f455 req-f39f014d-d541-4781-b8c0-1036aa507cfe service nova] Creating event network-changed:8d32b2ae-696c-4691-9736-3ca1147eff32 for instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 on hv-cinder-81920 Dec 16 18:03:21.720855 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-3dc1433a-4a8c-4d44-ab2f-5ae39456f455 req-f39f014d-d541-4781-b8c0-1036aa507cfe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045171 Dec 16 18:03:21.722050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 523/1068] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:22.593675 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:22.594328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:22.601692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:22.602253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:22.603189 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:22.603717 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:22.746451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:22.754816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0fe9cb75-5dc0-4a16-932f-e0ce04fa35e2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.165274 Dec 16 18:03:22.755406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 546/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:22 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:23.777139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:23.777830 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:23.784661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:23.785110 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:23.785903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:23.786331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:23.929835 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:23.938354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6115f2e5-85a5-4f3d-9625-36dd2dd63ce0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.165881 Dec 16 18:03:23.938969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 524/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:23 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:24.962559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:24.963571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:24.971562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:24.972436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:24.973319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:24.973955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:25.118285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:25.126482 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d96d2d9d-ce1b-4ee4-ab4d-7668b8748be3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.169121 Dec 16 18:03:25.127074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 547/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:24 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:26.146048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:26.146772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:26.153641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:26.154146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:26.155009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:26.155444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:26.306149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:26.313875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a1e19044-d4a0-4d18-974e-c72e58980ce8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.171429 Dec 16 18:03:26.314313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 525/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:26 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:27.331739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:27.332273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:27.339786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:27.340235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:27.341029 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:27.341457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:27.496303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:27.503907 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-05a2cf60-c237-47ec-a019-29abb49a68f3 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.176659 Dec 16 18:03:27.504477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 548/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:27 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:28.522011 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:28.522764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:28.529775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:28.530216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:28.531030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:28.531451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:28.677434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:28.685723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6c702039-5b99-4805-b147-5272e3ce5421 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.167474 Dec 16 18:03:28.686285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 526/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:28 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:29.249838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-463b6ac9-3b08-47c6-ac44-cc26c6ce37f7 req-e0283969-488f-4da6-a4b6-8f3129957483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baf3ec0-6bf3-4ec7-93ce-46d3471c9984", "name": "network-vif-plugged", "status": "completed", "tag": "8d32b2ae-696c-4691-9736-3ca1147eff32"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:29.252009 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:29.252009 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:03:29.263336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-463b6ac9-3b08-47c6-ac44-cc26c6ce37f7 req-e0283969-488f-4da6-a4b6-8f3129957483 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:29.263777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-463b6ac9-3b08-47c6-ac44-cc26c6ce37f7 req-e0283969-488f-4da6-a4b6-8f3129957483 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:29.276185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-463b6ac9-3b08-47c6-ac44-cc26c6ce37f7 req-e0283969-488f-4da6-a4b6-8f3129957483 service nova] Creating event network-vif-plugged:8d32b2ae-696c-4691-9736-3ca1147eff32 for instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 on hv-cinder-81920 Dec 16 18:03:29.282309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-463b6ac9-3b08-47c6-ac44-cc26c6ce37f7 req-e0283969-488f-4da6-a4b6-8f3129957483 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037816 Dec 16 18:03:29.283102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 549/1075] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:29.704686 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:29.705324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:29.713926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:29.714365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:29.715212 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:29.715637 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:29.867121 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:29.874558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6d7a582f-4c7c-414e-b5a3-f474aac7d362 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.174042 Dec 16 18:03:29.875170 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 527/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:29 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:30.892188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:30.892881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:30.901560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:30.902087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:30.902995 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:30.903541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:31.067678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:31.076167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b4bfcaef-3246-47d7-b7d3-b2f138a512b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1364 microversion: 2.1 time: 0.188506 Dec 16 18:03:31.076816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 550/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:30 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:32.098150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:32.098754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:32.106261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:32.106749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:32.107532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:32.107995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:32.433715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:32.442538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c1a3758f-c30e-403f-a741-72e908950541 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1549 microversion: 2.1 time: 0.348283 Dec 16 18:03:32.443739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 528/1078] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:32 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1549 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:32.459920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:32.460810 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:32.469310 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:32.469770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:32.471293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:32.471652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:32.561404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5451de17-4d18-44b1-b7ac-9ac3d517606a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105347 Dec 16 18:03:32.562322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 551/1079] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Dec 16 18:03:32 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:03:33.570104 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:33.576748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-e0a09ca2-08f2-4077-a5af-48f042530786 req-d5760d88-7670-4e89-8bbd-eb6ec84d70ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1baf3ec0-6bf3-4ec7-93ce-46d3471c9984", "tag": "8d32b2ae-696c-4691-9736-3ca1147eff32"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:33.577626 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:33.578409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:33.578409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:03:33.586150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-e0a09ca2-08f2-4077-a5af-48f042530786 req-d5760d88-7670-4e89-8bbd-eb6ec84d70ca service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:33.586560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-e0a09ca2-08f2-4077-a5af-48f042530786 req-d5760d88-7670-4e89-8bbd-eb6ec84d70ca service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:33.587460 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:33.587938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:33.589152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:33.589602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:33.600863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-e0a09ca2-08f2-4077-a5af-48f042530786 req-d5760d88-7670-4e89-8bbd-eb6ec84d70ca service nova] Creating event network-changed:8d32b2ae-696c-4691-9736-3ca1147eff32 for instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 on hv-cinder-81920 Dec 16 18:03:33.606550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-e0a09ca2-08f2-4077-a5af-48f042530786 req-d5760d88-7670-4e89-8bbd-eb6ec84d70ca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Dec 16 18:03:33.607391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 552/1080] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:33.661176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc4459e1-92fd-4acd-86c0-1aee18214f42 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.095037 Dec 16 18:03:33.662144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 529/1081] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:33 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:34.674271 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:34.675736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:34.683434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:34.683893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:34.684700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:34.685132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:34.760735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c238afc8-4440-4344-839b-d6301f17be2b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.090585 Dec 16 18:03:34.761474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 553/1082] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:34 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:35.777299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:35.778313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:35.785722 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:35.786164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:35.786997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:35.787439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:35.848682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-19c52348-ed43-4a10-92b8-8be042aef1a6 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.078396 Dec 16 18:03:35.849330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 530/1083] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:35 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:36.862666 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:36.863701 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:36.871957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:36.872425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:36.873280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:36.873770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:36.936014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d1b8fa56-8023-4e26-bce7-cc2f92d5b1ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.077560 Dec 16 18:03:36.936562 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 554/1084] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:36 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:37.951776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:37.953331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:37.964400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:37.965261 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:37.966161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:37.966609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:38.040713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-52b454a9-4602-4251-8937-1065d839b1a4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.094714 Dec 16 18:03:38.041558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 531/1085] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:37 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:39.054576 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:39.055519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:39.062884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:39.063323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:39.064097 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:39.064528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:39.130325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bca294db-72ae-4bdd-aaee-f6d87d5466bc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.079299 Dec 16 18:03:39.131163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 555/1086] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:39 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:40.148029 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:40.149627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:40.158911 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:40.159412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:40.160268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:40.160751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:40.225630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-002901a5-ec13-44e0-af3c-031d4591f4ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.084146 Dec 16 18:03:40.226242 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 532/1087] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:40 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:41.238766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:41.239781 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:41.251648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:41.252391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:41.253673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:41.254325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:41.322119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b97850ee-5ee5-48fd-a133-8de60c5e1597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.087208 Dec 16 18:03:41.322958 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 556/1088] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:41 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:42.334987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:42.336003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:42.344391 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:42.344849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:42.345634 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:42.346106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:42.410207 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0d211541-5ee9-4bec-817c-752c2e312485 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.079086 Dec 16 18:03:42.410991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 533/1089] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:42 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:43.425084 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:43.426100 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:43.433369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:43.433817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:43.434656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:43.435621 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:43.503998 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e34e8821-71e0-41c5-a115-9fd8823fb88c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 14 microversion: 2.1 time: 0.082386 Dec 16 18:03:43.504695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 557/1090] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:43 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:03:44.517758 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:44.519318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:44.530165 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:44.530640 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:44.531409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:44.531837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:44.608801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c13c2021-268b-48e4-825a-2bf94a88bf95 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 11050 microversion: 2.1 time: 0.096016 Dec 16 18:03:44.609466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 534/1091] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:44 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 11050 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:45.621221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:45.622291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:45.630731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:45.631236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:45.632034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:45.632588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:45.753989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b623676f-c550-48bd-b1a2-9a7dde4c2c7a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 17931 microversion: 2.1 time: 0.136706 Dec 16 18:03:45.754710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 558/1092] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:45 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 17931 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:46.770845 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:46.772563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:46.782339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:46.782794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:46.783612 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:46.784046 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:46.873265 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3123e565-f43d-4641-8b81-5ffed3c433c1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 18961 microversion: 2.1 time: 0.109182 Dec 16 18:03:46.873903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 535/1093] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:46 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 18961 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:47.886012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:47.887045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:47.894434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:47.894904 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:47.895682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:47.896164 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:47.972227 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bee639fe-e5d4-4a75-82cd-81f30e4583f4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 21226 microversion: 2.1 time: 0.090099 Dec 16 18:03:47.972910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 559/1094] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:47 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 21226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:48.986558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:48.987719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:48.995802 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:48.996509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:48.997749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:48.998508 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:49.075405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-acced9d3-8420-4ce5-97a9-be5808eafe5c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 22980 microversion: 2.1 time: 0.093980 Dec 16 18:03:49.075939 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 536/1095] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:48 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 22980 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:50.088354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:50.089297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:50.096457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:50.096887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:50.097670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:50.098105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:50.193039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-597c84d8-deab-435a-802a-2f872855f041 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 23803 microversion: 2.1 time: 0.109045 Dec 16 18:03:50.193684 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 560/1096] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:50 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 23803 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:51.206583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:51.207660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:51.215530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:51.215973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:51.216790 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:51.217221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:51.294397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a1eb8670-c75e-4668-bb34-3a99a0f1e24a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 25003 microversion: 2.1 time: 0.092318 Dec 16 18:03:51.294970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 537/1097] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:51 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 25003 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:52.307965 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:52.308979 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:52.318396 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.319125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.320369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.321072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.349591 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:52.350199 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:52.357335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.357838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.358659 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.359095 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.390673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b1857d7e-54d5-47de-95d8-14b421b209f7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments/a4e80750-de2a-4d6c-a235-fe035300580e" status: 200 len: 194 microversion: 2.20 time: 0.045242 Dec 16 18:03:52.391257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 538/1098] 10.222.0.32 () {60 vars in 1453 bytes} [Thu Dec 16 18:03:52 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments/a4e80750-de2a-4d6c-a235-fe035300580e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:52.420913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-36c4ccc5-2abd-4028-84b2-2cdc1d8d9629 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 26306 microversion: 2.1 time: 0.116885 Dec 16 18:03:52.421949 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 561/1099] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:52 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 26306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:52.458151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:52.458647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:52.466044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.466526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.467345 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.467772 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.569280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lazy-loading 'services' on Instance uuid 5f9dd6ae-7f47-4593-bf30-0df596f5046a {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:03:52.653149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-05ea2b88-436a-41ca-9d61-1f1dd452f822 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments/a4e80750-de2a-4d6c-a235-fe035300580e" status: 202 len: 0 microversion: 2.20 time: 0.199010 Dec 16 18:03:52.653767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 539/1100] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Dec 16 18:03:52 2021] DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments/a4e80750-de2a-4d6c-a235-fe035300580e => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:03:52.663151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:52.664283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:52.671731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.672371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.673335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:52.673903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:52.707206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-99124b95-086a-44b2-a6b6-53b4ef64a019 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048358 Dec 16 18:03:52.707784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 562/1101] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Dec 16 18:03:52 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 18:03:53.434302 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:53.435402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:53.442050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.442500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.443328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.443759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.525811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e3c891e2-af9f-4922-81ab-b946e451159e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 27227 microversion: 2.1 time: 0.095875 Dec 16 18:03:53.526667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 540/1102] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:53 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 27227 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:53.719809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:53.720714 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:53.728090 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.728534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.729324 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.729771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.761117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-37c297f6-54a6-43c9-9d39-6af6bc087d32 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045257 Dec 16 18:03:53.761671 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 563/1103] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Dec 16 18:03:53 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:53.835676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:53.836282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:53.844695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.845913 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.846869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.847316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.877746 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:03:53.972575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-03b9e80c-874d-4186-8dc1-f842931046be tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 204 len: 0 microversion: 2.20 time: 0.140818 Dec 16 18:03:53.973169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 541/1104] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Dec 16 18:03:53 2021] DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 18:03:53.981406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:53.982032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:53.991106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.991709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:53.992554 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:53.992984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:54.149927 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:54.158480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:54.160018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:54.161184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9b8cce94-5c0b-46aa-bf6a-61650fc16b72 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.183650 Dec 16 18:03:54.161759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 564/1105] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:03:53 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:03:54.542581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:54.544132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:54.553031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:54.553485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:54.554283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:54.554752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:54.642123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cdf03ae7-7b21-4ba9-95da-305b5b69d597 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 27748 microversion: 2.1 time: 0.105880 Dec 16 18:03:54.642878 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 542/1106] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:54 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 27748 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:55.184044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:55.184651 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:55.192304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:55.192747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:55.193569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:55.194036 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:55.349553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:55.358167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:55.359770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:55.361248 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d0b87833-8565-4adc-9e31-86fd008eadf7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.183003 Dec 16 18:03:55.361814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 565/1107] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:03:55 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:03:55.656034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:55.657054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:55.664807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:55.665237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:55.666059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:55.666497 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:55.803861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-14f02b59-f23f-48e6-98c1-1e2da32b6ac7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 27974 microversion: 2.1 time: 0.151747 Dec 16 18:03:55.804520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 543/1108] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:55 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 27974 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:56.379257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:56.379848 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:56.386652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:56.387142 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:56.387935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:56.388372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:56.525647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:56.533652 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:56.535604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:56.536783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a7c3a8eb-8372-4dad-862f-d34347e964dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 200 len: 1724 microversion: 2.20 time: 0.161433 Dec 16 18:03:56.537353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 566/1109] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:03:56 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:03:56.815487 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:56.816607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:56.824027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:56.824565 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:56.825449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:56.825952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:56.904356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c8348267-08b3-49cd-8c4b-9bd03b38cecd tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.092841 Dec 16 18:03:56.905013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 544/1110] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:56 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:03:56.998986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-60fd00f9-bdd9-45ea-ba53-ca917b142e34 req-21ae7677-e12e-4780-9b91-a0d238720258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dd6ae-7f47-4593-bf30-0df596f5046a", "name": "network-vif-deleted", "tag": "4bd2036f-01a2-4971-8fcb-d0d439424322"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:57.000743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:03:57.000743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:03:57.008970 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-60fd00f9-bdd9-45ea-ba53-ca917b142e34 req-21ae7677-e12e-4780-9b91-a0d238720258 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.009298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-60fd00f9-bdd9-45ea-ba53-ca917b142e34 req-21ae7677-e12e-4780-9b91-a0d238720258 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.020981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-60fd00f9-bdd9-45ea-ba53-ca917b142e34 req-21ae7677-e12e-4780-9b91-a0d238720258 service nova] Creating event network-vif-deleted:4bd2036f-01a2-4971-8fcb-d0d439424322 for instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a on hv-cinder-81920 Dec 16 18:03:57.026731 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-60fd00f9-bdd9-45ea-ba53-ca917b142e34 req-21ae7677-e12e-4780-9b91-a0d238720258 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Dec 16 18:03:57.027273 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 567/1111] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:03:57.556285 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:57.556989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:57.564081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.564646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.565526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.566038 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.581333 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:57.583024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:57.583910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. Dec 16 18:03:57.584618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:03:57.585528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-65c2d236-e2e3-41f5-a350-20d0f1e29342 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 404 len: 111 microversion: 2.20 time: 0.033544 Dec 16 18:03:57.586571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 545/1112] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:03:57 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:03:57.594740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.595417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.596460 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.596969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.599083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fecabc19-d0f1-4adb-b678-feb973c104c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '.version_select at 0x7fca17749c10>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:57.622358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fecabc19-d0f1-4adb-b678-feb973c104c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873861498" status: 204 len: 0 microversion: 2.20 time: 0.029891 Dec 16 18:03:57.623906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 546/1113] 10.222.0.32 () {60 vars in 1261 bytes} [Thu Dec 16 18:03:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873861498 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 18:03:57.710598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bc83f1c8-6b2c-4719-a084-1f1023291fcc tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action" status: 202 len: 0 microversion: 2.1 time: 0.132788 Dec 16 18:03:57.711545 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 568/1114] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:57 2021] POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:03:57.722379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:57.722379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:57.732710 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.733297 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.734223 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.734841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.917934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:57.919046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:57.927843 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.928370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.929253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:57.929747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:57.998525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-70875105-da2d-456b-8d0a-f20a7ca9e93d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.085168 Dec 16 18:03:57.999478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 569/1115] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:57 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 18:03:58.158745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:58.169375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fb7ad87b-ea15-4758-ad76-9e2df2dcfdda tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1750 microversion: 2.1 time: 0.452000 Dec 16 18:03:58.170566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 547/1116] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:57 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1750 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:03:59.011223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:59.012228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:59.024821 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:59.025735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:59.026745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:59.027272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:59.091720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-443cd936-d2bd-421c-af10-8d402646e92a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.084501 Dec 16 18:03:59.092482 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 570/1117] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:03:59 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 18:03:59.093224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: .version_select at 0x7fca1c0f2c10>, body: {"keypair": {"name": "tempest-keypair-1249433358"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:03:59.107589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:03:59.111445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:03:59.188516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:03:59.189419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:03:59.196839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:59.197590 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:59.198454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:03:59.199018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:03:59.291627 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:03:59.295354 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'key_pairs'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:03:59.309452 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8f896d9b-9970-4c24-8490-ff52206589ed tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.220423 Dec 16 18:03:59.310039 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 548/1118] 10.222.0.32 () {62 vars in 1198 bytes} [Thu Dec 16 18:03:59 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 16 18:03:59.360526 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:03:59.368815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b1c26bc0-7366-4769-8028-c682c5229a70 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.184627 Dec 16 18:03:59.369331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 571/1119] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:03:59 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:04:00.105718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:00.107071 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:00.114175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:00.114817 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:00.115742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:00.116177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:00.187292 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-98fa3f72-f64d-4401-b9cd-1f6e30494519 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.087003 Dec 16 18:04:00.192369 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 549/1120] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:00 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:00.386845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:00.387645 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:00.395472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:00.395935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:00.396709 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:00.397136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:00.580682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:00.590766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d7a02ac8-48ac-4fd5-a7c1-67aec0bf65e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.207625 Dec 16 18:04:00.591455 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 572/1121] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:00 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:00.912586 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-996745807", "imageRef": "aec2c339-3241-4cff-b2c4-0f82b05d300a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3aad32db-9062-48c6-b8ca-474a8b1c9b58"}], "security_groups": [{"name": "tempest-securitygroup--864533755"}], "key_name": "tempest-keypair-1249433358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:01.027619 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] validate_networks() for [('3aad32db-9062-48c6-b8ca-474a8b1c9b58', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:04:01.200649 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:01.201632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:01.210900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.211691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.213553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.214207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.283505 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c326fdc8-ca1b-4157-adb7-d4ec6449f0b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.086771 Dec 16 18:04:01.284287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 573/1122] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:01 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 18:04:01.479996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:04:01.479996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:04:01.480277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:04:01.480731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:04:01.481137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:04:01.493730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.494201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.495088 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.495527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.515294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for project af23b4f4f497464fac434ca5b8be6ead. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:04:01.522413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Getting quotas for user 634f9c0a59a94b4d8aad71ec93b6c11d and project af23b4f4f497464fac434ca5b8be6ead. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:04:01.536859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:04:01.540317 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aec2c339-3241-4cff-b2c4-0f82b05d300a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:04:01.608274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-01b1cc15-e60a-47ec-872c-0d0daa5a2835 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.700224 Dec 16 18:04:01.609386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 550/1123] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Dec 16 18:04:00 2021] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 18:04:01.614761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:01.617515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:01.624462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:01.625608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:01.625997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.626487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.627401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:01.628007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:01.712135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:01.723037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:01.725432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:01.727709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5dace445-6e6e-4753-99b0-1dc6ca8f9209 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1281 microversion: 2.20 time: 0.108724 Dec 16 18:04:01.727709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 551/1124] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:01 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:04:01.855261 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:01.867102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-725ee6be-0d38-4e45-a3e2-de24130c0b25 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.261118 Dec 16 18:04:01.867788 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 574/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:01 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:04:02.296290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:02.297209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:02.305334 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.305778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:02.306570 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.307036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:02.369074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3047bd08-9cb8-4b32-afa8-86f3336fea6b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.076466 Dec 16 18:04:02.374679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 552/1126] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:02 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:02.747908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:02.748535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:02.755284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.755683 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:02.756723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.757159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:02.826956 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:02.835401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:02.836888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:02.838573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1af7b00b-a330-40b2-aad2-db37cc1ee296 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1351 microversion: 2.20 time: 0.094866 Dec 16 18:04:02.839163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 575/1127] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:02 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:02.884893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:02.885630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:02.894844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.895658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:02.897127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:02.897898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:03.116656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:03.125498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ed9abb94-ec94-45e7-89c1-5ae1f03b2c1a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.244532 Dec 16 18:04:03.126103 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 553/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:02 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:03.383239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:03.384678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:03.391644 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:03.392089 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:03.392887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:03.393454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:03.523010 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2b2c12ea-34d6-4de9-a621-404bdae60986 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.143707 Dec 16 18:04:03.524037 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 576/1129] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:03 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:03.857047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:03.857663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:03.864965 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:03.865457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:03.866581 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:03.867246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.103652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:04.112863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:04.114876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:04.116127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9aa561dc-e60f-4c83-b231-6f684a0c22d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.263127 Dec 16 18:04:04.116765 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 554/1130] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:03 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:04.144317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:04.145230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:04.153340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:04.153786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.154583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:04.155144 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.294313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-04b0a6f2-8c03-4bfb-bc64-10370370bf23 req-c0a03a2c-dbc4-4361-bc17-6c967c2e4c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:04.296774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:04:04.296774 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:04:04.308067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-04b0a6f2-8c03-4bfb-bc64-10370370bf23 req-c0a03a2c-dbc4-4361-bc17-6c967c2e4c41 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:04.308608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-04b0a6f2-8c03-4bfb-bc64-10370370bf23 req-c0a03a2c-dbc4-4361-bc17-6c967c2e4c41 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.321667 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-04b0a6f2-8c03-4bfb-bc64-10370370bf23 req-c0a03a2c-dbc4-4361-bc17-6c967c2e4c41 service nova] Creating event network-changed:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:04:04.327131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-04b0a6f2-8c03-4bfb-bc64-10370370bf23 req-c0a03a2c-dbc4-4361-bc17-6c967c2e4c41 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037752 Dec 16 18:04:04.328388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 555/1131] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:04:04.333955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:04.343286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b1a3ddba-cc5f-4913-96b9-dbd4ca79414a tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.203178 Dec 16 18:04:04.343863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 577/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:04 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:04.535767 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:04.536913 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:04.543591 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:04.544000 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.544794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:04.545198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:04.608540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cd6392d5-84ed-44f7-bd6e-36ff685c8475 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.076560 Dec 16 18:04:04.609069 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 556/1133] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:04 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:05.138499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:05.139778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:05.148363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.149028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.149600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.150039 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.290886 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:05.299569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:05.301288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:05.302412 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8a5de9a7-711a-4e58-8483-ab873a1e7425 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.170459 Dec 16 18:04:05.302986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 578/1134] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:05 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:05.362023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:05.362742 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:05.373794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.374239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.375061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.375486 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.544711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:05.555943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4ef2aa1b-08bb-4e98-b1ee-0ff2473717b2 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.197977 Dec 16 18:04:05.556714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 557/1135] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:05 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:05.623598 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:05.625115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:05.633315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.633764 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.634552 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:05.635016 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:05.698911 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-679d7acd-ae4b-4f95-9686-2448941e0ee1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.081318 Dec 16 18:04:05.699543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 579/1136] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:05 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:06.319949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:06.320898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:06.330093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.330563 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.331400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.331841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.471120 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:06.484570 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:06.487135 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:06.488973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-51c5f3d6-bbc0-4aa2-9bd2-82558b0d68d8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.173025 Dec 16 18:04:06.489507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 558/1137] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:06 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:06.578286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:06.578977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:06.586791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.587241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.588406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.588837 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.714527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:06.715828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:06.722998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.723417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.724234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:06.724669 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:06.749918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:06.759015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1d58f47d-509c-47ae-a231-f746cbf2542f tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.184875 Dec 16 18:04:06.759586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 580/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:06 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:06.819805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5c5f0b6f-1b54-4966-a45c-2b4c94917a48 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.111365 Dec 16 18:04:06.820652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 559/1139] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:06 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:07.511076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:07.512150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:07.522135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.522589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.523427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.523858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.664263 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:07.672242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:07.673845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:07.674997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-23912b0c-fc1a-484b-b9ad-294b9780551d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.170901 Dec 16 18:04:07.675785 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 581/1140] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:07 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:07.778854 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:07.779703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:07.789512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.789965 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.790793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.791226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.834092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:07.835077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:07.842159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.842604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.843425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:07.843849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:07.911954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8aa875ac-c40d-4540-b5e0-4538da979952 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.082512 Dec 16 18:04:07.912857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 582/1141] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:07 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:07.951164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:07.960328 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9c9db72a-e3a1-4697-8716-0a95a4da0af5 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.187076 Dec 16 18:04:07.960892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 560/1142] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:07 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:08.695803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:08.696457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:08.704409 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.704844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.705642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.706216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.863909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:08.879556 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:08.881088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:08.882222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-082f3a84-d6c3-41fb-984c-f807f6176c14 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.191617 Dec 16 18:04:08.882829 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 583/1143] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:08 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:08.923987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:08.924919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:08.932265 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.932703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.933517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.933968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.983268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:08.983787 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:08.990766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.991214 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.992017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:08.992479 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:08.999714 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ed91dd59-d34f-483a-a367-a1c0de730f16 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.079420 Dec 16 18:04:09.003719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 561/1144] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:08 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:09.152299 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:09.162834 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4d1a03c1-4d7e-43e6-bcef-e2e84ae833e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1755 microversion: 2.1 time: 0.183211 Dec 16 18:04:09.163524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 584/1145] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:08 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:09.903626 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:09.904335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:09.911440 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:09.911865 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:09.912664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:09.913084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:10.010804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:10.011759 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:10.018264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:10.018749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:10.019543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:10.020724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:10.056282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:10.064090 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:10.065580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:10.067308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c144357b-f41d-4877-865c-c992aae8f5f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.167420 Dec 16 18:04:10.067941 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 562/1146] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:09 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:10.147910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9cb46a35-31df-4945-8ea0-0343b96dac70 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28228 microversion: 2.1 time: 0.140638 Dec 16 18:04:10.148570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 585/1147] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:10 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28228 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:10.181688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:10.182403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:10.189388 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:10.189838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:10.190642 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:10.191118 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:10.361538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:10.373739 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-84366c20-3f09-4474-8967-2a4afcadad59 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1758 microversion: 2.1 time: 0.196069 Dec 16 18:04:10.374538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 563/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:10 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:11.088430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:11.089243 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:11.098840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:11.099436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:11.100293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:11.100736 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:11.163519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:11.164439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:11.170922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:11.171409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:11.172192 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:11.172625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:11.248913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:11.251121 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2e9c2b1f-63e8-4858-a067-8ef3a142efad tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28519 microversion: 2.1 time: 0.093106 Dec 16 18:04:11.252116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 564/1149] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:11 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28519 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:11.260688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:11.262191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:11.263378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3433556d-075c-4476-8dd3-9a142bdaffcd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.181238 Dec 16 18:04:11.263950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 586/1150] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:11 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:11.432740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-84f0536b-fd82-40a5-a8bf-a9fc8b56556c req-7c9a56d4-8675-4adc-9924-4f507948da9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "name": "network-vif-plugged", "status": "completed", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:11.434342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:04:11.434342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:04:11.444168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-84f0536b-fd82-40a5-a8bf-a9fc8b56556c req-7c9a56d4-8675-4adc-9924-4f507948da9b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:11.444168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-84f0536b-fd82-40a5-a8bf-a9fc8b56556c req-7c9a56d4-8675-4adc-9924-4f507948da9b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:11.458769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-84f0536b-fd82-40a5-a8bf-a9fc8b56556c req-7c9a56d4-8675-4adc-9924-4f507948da9b service nova] Creating event network-vif-plugged:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:04:11.464406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-84f0536b-fd82-40a5-a8bf-a9fc8b56556c req-7c9a56d4-8675-4adc-9924-4f507948da9b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036276 Dec 16 18:04:11.465022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 565/1151] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:04:12.263490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:12.264424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:12.271762 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:12.272212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:12.273012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:12.273443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:12.281880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:12.282578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:12.290557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:12.291030 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:12.291854 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:12.292289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:12.336380 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-67199b7a-bcee-4175-9531-1ef256748d58 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28519 microversion: 2.1 time: 0.076572 Dec 16 18:04:12.341008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 587/1152] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:12 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28519 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:12.439305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:12.448571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:12.450023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:12.451208 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fe713a35-1d8e-4eb6-bba3-85d6fa7ed72f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1406 microversion: 2.20 time: 0.173554 Dec 16 18:04:12.451776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 566/1153] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:12 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:13.350321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:13.351348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:13.358790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.359246 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.360034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.360472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.438413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d391fe06-a875-4aa1-b479-64a2abba20a2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.091749 Dec 16 18:04:13.439244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 588/1154] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:13 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:13.474543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:13.475148 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:13.482069 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.482512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.483325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.483753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.632138 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:13.645499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:13.647161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:13.648568 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-28dbbb51-6ee8-4fec-8cf5-ead7c8054efa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1598 microversion: 2.20 time: 0.179771 Dec 16 18:04:13.649150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 567/1155] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:04:13 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:13.667486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:13.668073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:13.675288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.675726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.677051 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:13.677483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:13.765424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fea21a48-1e96-4116-bce1-13a05ef0271e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102091 Dec 16 18:04:13.766043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 589/1156] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Dec 16 18:04:13 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:14.450540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:14.451495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:14.457923 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:14.458378 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:14.459235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:14.459672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:14.526470 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3dbfa0d7-99f8-47bb-a4e8-7f423136bc4d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.079444 Dec 16 18:04:14.527198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 568/1157] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:14 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:14.794045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-a5f9a76b-55e5-4c7d-985c-5fb5daf8ee5c req-3a750e97-afc5-400c-8ba0-ce0cdb18249c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:14.796303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:04:14.796303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:04:14.804289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:14.805342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:14.810200 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-a5f9a76b-55e5-4c7d-985c-5fb5daf8ee5c req-3a750e97-afc5-400c-8ba0-ce0cdb18249c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:14.810737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-a5f9a76b-55e5-4c7d-985c-5fb5daf8ee5c req-3a750e97-afc5-400c-8ba0-ce0cdb18249c service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:14.812439 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:14.812877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:14.813920 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:14.814538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:14.824359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-a5f9a76b-55e5-4c7d-985c-5fb5daf8ee5c req-3a750e97-afc5-400c-8ba0-ce0cdb18249c service nova] Creating event network-changed:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:04:14.830006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-a5f9a76b-55e5-4c7d-985c-5fb5daf8ee5c req-3a750e97-afc5-400c-8ba0-ce0cdb18249c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040035 Dec 16 18:04:14.830931 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 569/1158] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:04:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:04:14.887758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d9f7d36c-e7e2-48d6-a833-2e63147c3b92 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.099213 Dec 16 18:04:14.888738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 590/1159] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:14 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:15.539372 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:15.540293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:15.547178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:15.547631 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:15.548454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:15.548889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:15.612061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-42599478-5c08-4682-9bd0-7292c9fcd5df tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.077331 Dec 16 18:04:15.616984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 570/1160] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:15 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:15.904149 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:15.905394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:15.913081 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:15.913535 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:15.914348 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:15.915503 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:15.982667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-446964cd-5592-4e7f-a00d-c52287708a7a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.085561 Dec 16 18:04:15.983319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 591/1161] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:15 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:16.625290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:16.626353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:16.633798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:16.634250 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:16.635077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:16.635511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:16.699829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-077f96bc-71a6-4fbd-b5ed-2dae587f7473 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.078448 Dec 16 18:04:16.700480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 571/1162] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:16 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:16.994943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:16.995967 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:17.003487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:17.003934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:17.004882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:17.005511 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:17.068524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6b87f4c7-d396-47d0-b453-733942735007 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.077826 Dec 16 18:04:17.069154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 592/1163] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:16 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:17.712955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:17.713980 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:17.721229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:17.721656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:17.722432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:17.722893 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:17.791256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d1c533ab-c7e5-4b56-bab3-c8c2463c0423 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.082698 Dec 16 18:04:17.791906 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 572/1164] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:17 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:18.080589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:18.081509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:18.089350 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:18.089797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:18.090581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:18.091083 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:18.152629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7f4bcc51-bad8-4cad-bccb-837e7baec99d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.076076 Dec 16 18:04:18.153258 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 593/1165] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:18 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:18.804305 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:18.805327 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:18.812810 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:18.813365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:18.814193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:18.814709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:18.882235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-212429ec-cf2b-496a-b36e-c598a648c415 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.082101 Dec 16 18:04:18.882896 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 573/1166] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:18 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:19.167417 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:19.168940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:19.178242 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:19.178676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:19.179459 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:19.179877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:19.238438 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7d1aa251-5409-407d-84de-24c7bbf975cd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.077446 Dec 16 18:04:19.239116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 594/1167] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:19 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:19.894278 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:19.895405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:19.902776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:19.903216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:19.904002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:19.904426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:19.970814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e1a3d660-a6fe-498e-b53a-00657ad8b32f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.080512 Dec 16 18:04:19.971472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 574/1168] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:19 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:20.252750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:20.254245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:20.262175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:20.262642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:20.263431 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:20.263865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:20.324694 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f3c8bc66-9df2-4a8a-9009-65be366dc40a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.077996 Dec 16 18:04:20.325308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 595/1169] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:20 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:20.984086 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:20.985092 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:20.993214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:20.993671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:20.994611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:20.994930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:21.061358 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f5e630d3-e8ba-44a1-9b4d-239b9a6d8fec tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.081147 Dec 16 18:04:21.062266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 575/1170] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:20 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:21.338646 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:21.340085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:21.349352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:21.349800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:21.350588 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:21.351056 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:21.413846 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5a9e12ab-ed7d-4437-b5cb-c8248eb3a5d1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.080877 Dec 16 18:04:21.414461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 596/1171] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:21 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:22.076615 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:22.077620 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:22.085343 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:22.085787 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:22.086570 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:22.087028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:22.156352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-79c5f546-9c80-4312-a1ce-3de939adba9e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.084032 Dec 16 18:04:22.156993 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 576/1172] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:22 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:22.425694 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:22.427289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:22.434808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:22.435253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:22.436031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:22.436464 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:22.497650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-78bec233-78c5-4bb4-aed8-d5ea8b95b0a9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.075986 Dec 16 18:04:22.498291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 597/1173] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:22 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:23.168057 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:23.169067 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:23.176246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:23.176688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:23.177458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:23.177884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:23.249077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1e800987-2a9d-43e6-ab46-4b0a86ddb28e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.084914 Dec 16 18:04:23.249723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 577/1174] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:23 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:23.509508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:23.510530 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:23.517866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:23.518303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:23.519116 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:23.519539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:23.583738 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6b49313d-19e0-4602-b3dd-6017b4b6e399 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.078196 Dec 16 18:04:23.584386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 598/1175] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:23 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:24.262245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:24.263301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:24.270608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:24.271082 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:24.271875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:24.272313 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:24.353960 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8bcbcd8e-4944-4ade-b9f6-5c9b63c54ad4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.095628 Dec 16 18:04:24.354579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 578/1176] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:24 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:24.596968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:24.598068 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:24.605219 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:24.605658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:24.606434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:24.606887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:24.667134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c5912d9a-dd0b-4515-ac89-c32e9ab58d2a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 14 microversion: 2.20 time: 0.074129 Dec 16 18:04:24.667834 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 599/1177] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:24 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:04:25.366550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:25.367871 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:25.379052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:25.379713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:25.380511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:25.380949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:25.450989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9fd81350-ac79-4db9-b9ea-987bf49b0089 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.088429 Dec 16 18:04:25.451671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 579/1178] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:25 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:25.680669 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:25.681669 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:25.688697 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:25.689212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:25.689994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:25.690419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:25.771700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4cf1702f-e479-47c5-bab6-a8f5486e413a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 6202 microversion: 2.20 time: 0.094836 Dec 16 18:04:25.772639 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 600/1179] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:25 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 6202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:04:26.464724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:26.465721 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:26.472527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:26.472996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:26.473775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:26.474198 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:26.552670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4f489eef-5324-4e86-bd82-b277538b7235 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.092872 Dec 16 18:04:26.553768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 580/1180] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:26 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:26.788092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:26.789284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:26.798044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:26.798746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:26.799932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:26.800601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:26.876389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-778793b0-ec71-4066-b26b-a203d5d04a98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 15025 microversion: 2.20 time: 0.095082 Dec 16 18:04:26.877026 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 601/1181] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:26 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 15025 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:27.564958 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:27.565961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:27.573342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:27.573784 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:27.574561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:27.575016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:27.643880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-55c17f57-9f72-4443-88c6-8c3905e22464 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.082593 Dec 16 18:04:27.644747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 581/1182] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:27 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:27.891863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:27.892879 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:27.901053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:27.901510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:27.902289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:27.902761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:27.978551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-86ac4da5-bb5c-4a40-9fd5-cf86479bdbd4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 18498 microversion: 2.20 time: 0.093174 Dec 16 18:04:27.979466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 602/1183] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:27 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 18498 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:28.656517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:28.657527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:28.664697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:28.665141 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:28.665932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:28.666356 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:28.739284 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-93d3de7d-fee2-4e1b-8ba0-169b79e7c0cc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.086593 Dec 16 18:04:28.739917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 582/1184] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:28 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:28.992723 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:28.994774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:29.006938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:29.007401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:29.008327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:29.008772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:29.087241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-91907617-52cb-4556-b9ad-72c3c3fd82cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 19342 microversion: 2.20 time: 0.099283 Dec 16 18:04:29.088365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 603/1185] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:28 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 19342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:29.751012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:29.752036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:29.760129 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:29.760578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:29.761375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:29.761818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:29.832269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bfa5cab1-be82-43ce-ba42-b4aed8a55c8c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.085005 Dec 16 18:04:29.833233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 583/1186] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:29 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:30.103783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:30.105315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:30.116185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:30.116647 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:30.117432 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:30.117867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:30.201279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8c317323-7372-4fc7-84b7-95fb7cfcc64f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 22119 microversion: 2.20 time: 0.103696 Dec 16 18:04:30.202114 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 604/1187] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:30 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 22119 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:30.845500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:30.846505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:30.856771 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:30.857444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:30.858660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:30.859326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:30.931579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7f56ba33-6584-423c-b30e-22cf95a55a55 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.089952 Dec 16 18:04:30.932245 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 584/1188] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:30 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:31.215563 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:31.216610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:31.224115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:31.224565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:31.225353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:31.225789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:31.313696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a12fe291-da4b-421f-87e6-7f9b4f3f8966 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 23234 microversion: 2.20 time: 0.103170 Dec 16 18:04:31.314396 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 605/1189] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:31 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 23234 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:31.945751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:31.947071 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:31.954363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:31.954846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:31.955624 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:31.956059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:32.020394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5e2ceb4f-86a4-411d-9d2c-58e727bdb398 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.078635 Dec 16 18:04:32.021059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 585/1190] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:31 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:32.326481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:32.327457 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:32.335044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:32.335600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:32.336476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:32.336906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:32.416262 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-140ce4cd-5602-4bcb-91dd-b2f7a2f8560a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 24751 microversion: 2.20 time: 0.093373 Dec 16 18:04:32.417304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 606/1191] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:32 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 24751 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:33.033794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:33.034870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:33.042294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:33.042787 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:33.043608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:33.044045 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:33.114552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b4d964a0-2549-474a-864d-6778509f00db tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.084287 Dec 16 18:04:33.115489 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 586/1192] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:33 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:33.435289 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:33.436490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:33.446592 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:33.447056 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:33.447840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:33.448266 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:33.524221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1be7d8c5-d211-4732-93b4-320e36138608 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 26129 microversion: 2.20 time: 0.095802 Dec 16 18:04:33.525212 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 607/1193] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:33 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 26129 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:34.128172 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:34.129209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:34.136726 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:34.137178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:34.137967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:34.138399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:34.206365 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4e8e6a7f-181c-46d6-9446-ab775978573c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.082335 Dec 16 18:04:34.207041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 587/1194] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:34 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:34.537294 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:34.538253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:34.547065 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:34.547520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:34.548328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:34.548893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:34.635454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4058a727-7631-4476-99d9-b1a8da99fc19 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 27181 microversion: 2.20 time: 0.102208 Dec 16 18:04:34.636201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 608/1195] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:34 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 27181 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:35.219862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:35.220890 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:35.228108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:35.228544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:35.229325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:35.229756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:35.293937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-47bc9417-8244-4ae9-aa52-df9e2f9e55ca tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.078163 Dec 16 18:04:35.294561 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 588/1196] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:35 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:35.648722 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:35.649835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:35.660611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:35.661440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:35.663220 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:35.663803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:35.752674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2a1e4012-9e53-4fd4-82f3-f02708e49e89 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 27627 microversion: 2.20 time: 0.108274 Dec 16 18:04:35.753774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 609/1197] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:35 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 27627 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:36.305867 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:36.306955 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:36.314879 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.315326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.316517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.316656 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.387658 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-44f2e6d8-6714-4e74-816e-d38dd6d0a185 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.085655 Dec 16 18:04:36.391566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 589/1198] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:36 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:36.768195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:36.769192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:36.775935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.776484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.777815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.778245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.859058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-007cb68b-31e1-425e-807a-b9098048e9e9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 27954 microversion: 2.20 time: 0.094538 Dec 16 18:04:36.859602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 610/1199] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:36 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 27954 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:04:36.970153 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:36.970862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:36.972106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-75800e5f-15cf-44b9-b6a7-d8e788d6e1a2 req-5c6d6dc6-72c0-4edc-a881-8b93cb6ef054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:36.973674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:04:36.973674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:04:36.978523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.979099 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.979997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.980516 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.982283 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75800e5f-15cf-44b9-b6a7-d8e788d6e1a2 req-5c6d6dc6-72c0-4edc-a881-8b93cb6ef054 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:36.982748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-75800e5f-15cf-44b9-b6a7-d8e788d6e1a2 req-5c6d6dc6-72c0-4edc-a881-8b93cb6ef054 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:36.994284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-75800e5f-15cf-44b9-b6a7-d8e788d6e1a2 req-5c6d6dc6-72c0-4edc-a881-8b93cb6ef054 service nova] Creating event network-changed:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 18:04:37.000298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-75800e5f-15cf-44b9-b6a7-d8e788d6e1a2 req-5c6d6dc6-72c0-4edc-a881-8b93cb6ef054 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032030 Dec 16 18:04:37.000912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 611/1200] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:04:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:04:37.009617 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:04:37.099745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5260caf0-54a7-45ee-8ec1-3eef5b667abb tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "DELETE /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 204 len: 0 microversion: 2.1 time: 0.133245 Dec 16 18:04:37.100389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 590/1201] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:04:36 2021] DELETE /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:04:37.110458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:37.111163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:37.117670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.118119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.118955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.119392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.263864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:37.273548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-28853c31-7ac9-4df8-ad86-24419d43b5fd tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1565 microversion: 2.1 time: 0.167556 Dec 16 18:04:37.275145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 612/1202] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:37 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:37.400244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:37.401288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:37.409274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.409719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.410519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.410984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.475796 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-efce88e6-d903-410c-9ee3-1183659b5b6d tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.079399 Dec 16 18:04:37.477025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 591/1203] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:37 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:37.871321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:37.873087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:37.879973 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.880640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.881514 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:37.881975 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:37.969511 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ce8bfa6f-c904-4c44-bb5e-a7e1676ad1dc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28072 microversion: 2.20 time: 0.101507 Dec 16 18:04:37.970175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 613/1204] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:37 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28072 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:38.292458 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:38.293065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:38.300702 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.301144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:38.301928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.302463 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:38.449080 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:38.457094 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-da32dcc8-0a0e-4c45-8613-2f2672fcddf2 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1446 microversion: 2.1 time: 0.168872 Dec 16 18:04:38.457645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 592/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:38 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:38.490118 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:38.491233 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:38.498370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.498875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:38.499664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.500100 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:38.646228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1d9ca41d-d8a5-4391-bd06-a78f69488313 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.159544 Dec 16 18:04:38.647342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 614/1206] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:38 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:38.984720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:38.987201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:38.997683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.998270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:38.999101 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:38.999528 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.091847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1ea709f2-0f51-42fb-aa61-5999af944dfd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.112765 Dec 16 18:04:39.092536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 593/1207] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:38 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:39.476036 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:39.476695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:39.483653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:39.484101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.484961 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:39.485408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.502755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-52e6fddb-b29a-45a9-a695-0267bc01670c req-4baff0a9-e9dc-4d36-ab92-718ce106ee36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99662dab-b8ee-47d0-bd2c-342104e005c4", "name": "network-vif-deleted", "tag": "6d17d62c-a308-44c9-bf27-e54417dc07f0"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:39.504922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:04:39.504922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:04:39.514197 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-52e6fddb-b29a-45a9-a695-0267bc01670c req-4baff0a9-e9dc-4d36-ab92-718ce106ee36 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:39.514964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-52e6fddb-b29a-45a9-a695-0267bc01670c req-4baff0a9-e9dc-4d36-ab92-718ce106ee36 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.528050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-52e6fddb-b29a-45a9-a695-0267bc01670c req-4baff0a9-e9dc-4d36-ab92-718ce106ee36 service nova] Creating event network-vif-deleted:6d17d62c-a308-44c9-bf27-e54417dc07f0 for instance 99662dab-b8ee-47d0-bd2c-342104e005c4 on hv-cinder-81920 Dec 16 18:04:39.534602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-52e6fddb-b29a-45a9-a695-0267bc01670c req-4baff0a9-e9dc-4d36-ab92-718ce106ee36 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036002 Dec 16 18:04:39.535239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 594/1208] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:04:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:04:39.563625 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8317cb247b074647a1788f28f986ebc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f9c4f0e45341af9bb59fb5a170bba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:04:39.571684 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0c60a42d-51fb-4b8a-8d6c-5e58f2a1ce99 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 200 len: 1379 microversion: 2.1 time: 0.100207 Dec 16 18:04:39.572298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 615/1209] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:39 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 1379 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:04:39.663248 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:39.664241 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:39.671318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:39.671805 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.672593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:39.673025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:39.737645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5172f3c5-6b72-4afc-b5ef-dc267eb20d7f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.078647 Dec 16 18:04:39.738240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 595/1210] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:39 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:40.106415 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:40.107436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:40.115816 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.116264 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.117066 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.117495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.192304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-83a050da-4717-40d2-83d7-285e18dc1104 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.090952 Dec 16 18:04:40.193006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 616/1211] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:40 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:40.592249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:40.592947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] [instance: 99662dab-b8ee-47d0-bd2c-342104e005c4] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:40.600339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.600784 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.601582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.602015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.616919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] HTTP exception thrown: Instance 99662dab-b8ee-47d0-bd2c-342104e005c4 could not be found. Dec 16 18:04:40.617505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Returning 404 to user: Instance 99662dab-b8ee-47d0-bd2c-342104e005c4 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:04:40.618336 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-18b3de0b-d3c1-4d2c-92df-53ad21063dc6 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4" status: 404 len: 111 microversion: 2.1 time: 0.032392 Dec 16 18:04:40.618914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 596/1212] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:04:40 2021] GET /compute/v2.1/servers/99662dab-b8ee-47d0-bd2c-342104e005c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:04:40.750668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:40.753499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:40.761943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.762422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.763370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:40.763812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:40.817511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d0ccc76d-99ec-49be-b50d-a902371ec554 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] Calling method '.version_select at 0x7fca177ee0d0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:40.836968 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d0ccc76d-99ec-49be-b50d-a902371ec554 tempest-TestShelveInstance-110539618 tempest-TestShelveInstance-110539618-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503061536" status: 202 len: 0 microversion: 2.1 time: 0.023942 Dec 16 18:04:40.838370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 597/1213] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:04:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503061536 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:04:40.840609 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-87fbee96-f6dd-4ffc-baaf-c858b451e07c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.094340 Dec 16 18:04:40.841379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 617/1214] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:40 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:41.205185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:41.206412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:41.215052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:41.215492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:41.216423 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:41.216857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:41.284218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-57921209-3a9b-4fc4-9061-61414306d65e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.083294 Dec 16 18:04:41.284875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 598/1215] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:41 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:41.854201 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:41.855168 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:41.862817 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:41.863272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:41.864072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:41.864514 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:41.926248 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ba1a3f71-2466-46af-93d8-cf5268a39d33 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.076051 Dec 16 18:04:41.926994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 618/1216] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:41 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:42.301610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:42.303289 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:42.313709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:42.314525 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:42.315586 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:42.316257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:42.384531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-958131de-31b5-400c-bb65-45f1d94caa8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.087847 Dec 16 18:04:42.390213 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 599/1217] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:42 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:42.938372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:42.940311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:42.948003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:42.948427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:42.949422 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:42.950025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:43.020287 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4c7cf6f4-d088-4eab-8ef2-a8482369c96f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 28687 microversion: 2.1 time: 0.085878 Dec 16 18:04:43.021711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 619/1218] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:42 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 28687 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:43.400178 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:43.401821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:43.409574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:43.410014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:43.410921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:43.411357 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:43.484262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a1c1c06c-bf18-4ee6-ad4b-8acb572a9469 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.088185 Dec 16 18:04:43.485421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 600/1219] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:43 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:44.033130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:44.034354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:44.041963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:44.042939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:44.043833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:44.046740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:44.133845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-82f28261-79af-435b-990b-65187e035479 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 30518 microversion: 2.1 time: 0.104715 Dec 16 18:04:44.135078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 620/1220] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:44 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 30518 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:44.497523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:44.499547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:44.509935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:44.510352 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:44.511293 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:44.511792 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:44.582949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4af13961-12da-4067-b0c2-94f78be6e5b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.089699 Dec 16 18:04:44.583670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 601/1221] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:44 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:45.146176 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:45.147584 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:45.156236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:45.156660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:45.157471 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:45.158023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:45.237514 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6632ee67-a957-400c-a568-b837e42ebc90 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 32156 microversion: 2.1 time: 0.095186 Dec 16 18:04:45.239037 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 621/1222] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:45 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 32156 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:45.597618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:45.598673 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:45.606018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:45.606467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:45.609240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:45.609240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:45.685849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5c94289f-8ac2-43b8-888e-3f81f121020e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.092188 Dec 16 18:04:45.687162 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 602/1223] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:45 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:46.251031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:46.252713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:46.261290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:46.261997 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:46.263093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:46.264318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:46.356896 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d5d81658-4005-4f92-a80d-98776d407da0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 33239 microversion: 2.1 time: 0.110647 Dec 16 18:04:46.357861 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 622/1224] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:46 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 33239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:46.699708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:46.701054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:46.709234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:46.709686 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:46.710521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:46.710948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:46.778495 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fc609e38-3ba4-4d10-81ea-c1635e23d6ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.083876 Dec 16 18:04:46.779765 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 603/1225] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:46 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:47.370256 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:47.371319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:47.379091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:47.379537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:47.380321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:47.380986 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:47.463485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ce56707c-7a07-4304-9996-29c400efa6d5 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 34195 microversion: 2.1 time: 0.096632 Dec 16 18:04:47.465399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 623/1226] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:47 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 34195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:47.793751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:47.795754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:47.804323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:47.804858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:47.805740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:47.806229 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:47.883638 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-848e09e4-69ac-4ea3-9808-199e0f6a9589 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.094495 Dec 16 18:04:47.884712 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 604/1227] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:47 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:48.478414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:48.479566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:48.487042 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:48.487531 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:48.488335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:48.489036 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:48.566427 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f70cd83d-876e-4bc8-a0d9-b9886f633143 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 35704 microversion: 2.1 time: 0.092094 Dec 16 18:04:48.567108 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 624/1228] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:48 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 35704 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 18:04:48.897249 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:48.898151 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:48.905622 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:48.906106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:48.906949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:48.907382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:48.978681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3ec32c41-e11e-479a-9cb6-0adcd7df976e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.085480 Dec 16 18:04:48.984494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 605/1229] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:48 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:49.579739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:49.580791 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:49.588416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:49.588940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:49.589661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:49.590098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:49.669078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-12eb4bfb-6a39-41a5-a495-a5e9bb8a4e9c tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 37210 microversion: 2.1 time: 0.093742 Dec 16 18:04:49.669825 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 625/1230] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:49 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 37210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:49.996555 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:49.997989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:50.005523 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:50.005973 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:50.006809 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:50.007426 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:50.071754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2739bb53-32c7-4899-84c7-f3d6fc2d3692 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.079549 Dec 16 18:04:50.072375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 606/1231] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:49 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:50.681935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:50.683076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:50.690433 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:50.690898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:50.691696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:50.692158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:50.769410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-665db066-7181-49ec-9cd5-e37fe4920c6e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 38221 microversion: 2.1 time: 0.090951 Dec 16 18:04:50.770566 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 626/1232] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:50 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 38221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:51.083945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:51.084952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:51.093232 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:51.093683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:51.094462 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:51.094925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:51.165978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-768d55b2-6294-4db4-a516-9a0cae370df0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.086005 Dec 16 18:04:51.166646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 607/1233] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:51 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:51.783667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:51.784631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:51.792157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:51.792601 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:51.793410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:51.793881 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:51.867477 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-736680ec-63ce-4651-b453-da02422aced7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 38221 microversion: 2.1 time: 0.088047 Dec 16 18:04:51.868147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 627/1234] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:51 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 38221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:52.178669 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:52.179873 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:52.187773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:52.188215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:52.189072 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:52.189566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:52.258820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-12681c11-085d-4761-9da7-e63d118f98d6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28189 microversion: 2.20 time: 0.084186 Dec 16 18:04:52.259623 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 608/1235] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:52 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28189 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:52.882103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:52.883496 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:52.892367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:52.892824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:52.893695 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:52.894161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:52.969013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cbc40313-31d5-4f10-93c1-4e806c5adda2 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 38221 microversion: 2.1 time: 0.091968 Dec 16 18:04:52.969938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 628/1236] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:52 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 38221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:53.273812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:53.275421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:53.284216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:53.284652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:53.285449 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:53.285870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:53.376073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b3eec6ea-dc63-4d0b-bba4-64a9f2dec1fa tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28479 microversion: 2.20 time: 0.107814 Dec 16 18:04:53.376889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 609/1237] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:53 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28479 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:53.981980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:53.983173 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:53.991355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:53.991925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:53.992858 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:53.993269 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:54.061932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2b170c5a-c404-45d0-bc73-5391c8d66a62 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 38221 microversion: 2.1 time: 0.083285 Dec 16 18:04:54.062940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 629/1238] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:53 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 38221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:54.389840 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:54.390959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:54.398399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:54.398882 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:54.399683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:54.400111 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:54.488262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-10d15e2f-3974-4fb9-b8c7-282724af13cc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28532 microversion: 2.20 time: 0.102458 Dec 16 18:04:54.488925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 610/1239] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:54 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28532 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:55.075778 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:55.076906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:55.086357 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.087551 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.088866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.089605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.176408 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3490dec6-88d8-483c-8a69-2fb250cee3e4 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action" status: 200 len: 38352 microversion: 2.1 time: 0.104269 Dec 16 18:04:55.177109 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 630/1240] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:04:55 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/action => generated 38352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:04:55.190381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:04:55.191065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:55.200124 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.200628 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.201611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.202083 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.231137 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-67f0fa67-15c7-4417-8208-b706bbc2fd51 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/ips" status: 200 len: 145 microversion: 2.1 time: 0.046095 Dec 16 18:04:55.231723 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 611/1241] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 18:04:55 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:04:55.501706 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:55.502915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:55.511014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.511570 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.512541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:55.513045 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:55.597593 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5b446f59-6ef0-40f6-b8ae-60a3fabc83bb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.100962 Dec 16 18:04:55.598305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 631/1242] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:55 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:04:56.584564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bfd103a-1fc5-40d0-985a-0a1f8f5599b0"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:56.585631 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:56.592847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:56.593291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:56.594203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:56.594949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:56.610572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:56.611582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:56.619220 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:56.619815 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:56.620727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:56.621314 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:56.692686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b60e6f07-ab49-4544-9d39-9d984686ae22 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.086229 Dec 16 18:04:56.693580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 632/1243] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:56 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:04:56.862132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9e08fe8c-97be-4056-9319-88b50dcb951f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281229 Dec 16 18:04:56.862828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 612/1244] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 18:04:56 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:04:57.706340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:57.707478 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:57.715681 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:57.716179 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:57.717102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:57.717581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:57.792190 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-24a563ff-9384-414e-b757-32ec0867b243 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.090266 Dec 16 18:04:57.792846 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 633/1245] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:57 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:58.805837 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:58.807669 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:58.813716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:58.814160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:58.814995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:58.815433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:58.879176 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7ce4c74e-76b8-4171-b98f-bb8d480a8a26 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.077750 Dec 16 18:04:58.879819 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 613/1246] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:58 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:04:59.893823 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:04:59.894952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:04:59.902461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:59.902937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:59.903721 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:04:59.904146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:04:59.978582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5579cf8c-e06c-48ff-a42a-7054c70c2677 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.088973 Dec 16 18:04:59.979259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 634/1247] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:04:59 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:00.992618 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:00.993653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:01.001093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:01.001542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:01.002333 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:01.002811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:01.069808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-26248c18-8b07-4ea1-8a56-26afe3bb58f6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.081100 Dec 16 18:05:01.070382 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 614/1248] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:00 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:02.084186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:02.085301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:02.094665 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:02.094985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:02.095810 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:02.096239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:02.162870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e3b29762-13b8-4922-bc07-881c18f52fbd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.082875 Dec 16 18:05:02.163674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 635/1249] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:02 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:03.176841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:03.177851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:03.185139 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:03.185577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:03.186357 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:03.186823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:03.264589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3f3585f2-718c-48e2-a266-751022eea0ef tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.092264 Dec 16 18:05:03.269597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 615/1250] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:03 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:04.282919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:04.284586 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:04.291950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.292451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.293244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.293672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.356508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-68091e79-903c-4602-8a69-dd8145688e8e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.080669 Dec 16 18:05:04.357447 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 636/1251] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:04 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:04.392252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:04.393275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:04.400518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.400961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.401736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.402188 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.443926 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-43f0ebe3-d6da-4271-a963-99d1b2330221 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056146 Dec 16 18:05:04.444485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 616/1252] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:04 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:04.455106 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:04.455700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:04.463543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.463994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.464785 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:04.465224 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:04.496365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7f1a0821-a862-4421-ae5f-dac6cb59aed7 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0" status: 200 len: 194 microversion: 2.1 time: 0.045531 Dec 16 18:05:04.496940 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 637/1253] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Dec 16 18:05:04 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:05.369028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:05.369971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:05.376912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:05.377357 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:05.378146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:05.378578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:05.443524 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-07864099-9da0-4fee-81d0-7ad1c47783f4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.078168 Dec 16 18:05:05.444417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 617/1254] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:05 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:05.831622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b990e81-b9f1-4d85-a822-ed1d1fb1ce09"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:05.832698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:05.839649 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:05.840099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:05.840934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:05.841365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:06.084903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ac908e18-b58a-4026-83df-b516613de7b0 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257619 Dec 16 18:05:06.085532 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 638/1255] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Dec 16 18:05:05 2021] POST /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:06.459653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:06.460757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:06.469485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:06.470451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:06.471094 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:06.471520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:06.536664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9160b23d-ad02-40aa-b680-2747caf4e695 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.082302 Dec 16 18:05:06.537355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 618/1256] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:06 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:07.554533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:07.556354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:07.565947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:07.566414 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:07.567255 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:07.567691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:07.631761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-23a88737-e295-4432-ae10-48afab3b3521 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.084959 Dec 16 18:05:07.632379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 639/1257] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:07 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:08.644903 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:08.645886 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:08.653077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:08.653547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:08.654318 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:08.654778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:08.718166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1792479f-80cd-465f-b693-556f5d5cbb3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.077309 Dec 16 18:05:08.718877 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 619/1258] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:08 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:09.734172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:09.735343 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:09.745751 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:09.746247 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:09.747293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:09.747833 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:09.816604 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c103e5c7-aa8e-4353-82d3-1cb9b2215e9c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.088127 Dec 16 18:05:09.817481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 640/1259] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:09 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:10.829472 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:10.830468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:10.838156 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:10.838602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:10.839406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:10.839828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:10.906852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-94c7907d-753e-4041-8b7e-0f16c2eade8b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.080974 Dec 16 18:05:10.907664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 620/1260] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:10 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:11.924959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:11.927406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:11.939148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:11.939910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:11.941208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:11.942139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:12.084321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b4612521-e0c6-4e17-b031-a86e9a118a38 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.166133 Dec 16 18:05:12.084873 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 641/1261] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:11 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:13.099221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:13.100231 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:13.108089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.108576 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.109435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.109924 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.172930 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2f2a931b-080d-41f3-83f1-29bb877a3662 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.078286 Dec 16 18:05:13.173574 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 621/1262] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:13 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:13.595824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:13.596845 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:13.604406 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.604863 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.605650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.606087 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.643910 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-19b5bd2e-ae45-455b-bf5b-59db1092787f tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051989 Dec 16 18:05:13.644645 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 642/1263] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:13 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:13.863093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:13.864040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:13.871577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.872028 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.872823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.873256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.906140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-df1b72d3-cae8-465c-b352-bb4c4f6ed228 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0" status: 200 len: 194 microversion: 2.1 time: 0.050169 Dec 16 18:05:13.906801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 622/1264] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Dec 16 18:05:13 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:13.916524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:13.917032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:13.923567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.923991 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.924774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.925209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.962928 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1735733232"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:13.963800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:13.971731 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.972228 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:13.973121 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:13.973556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:14.120836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.network.security_group_api [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Removing security group 95fcd07d-2750-4e67-8850-8076191f9ed0 from port 247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 Dec 16 18:05:14.233210 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lazy-loading 'services' on Instance uuid 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:05:14.307043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-22b400ab-2857-4278-9d3b-c599f8b8229a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0" status: 202 len: 0 microversion: 2.1 time: 0.394017 Dec 16 18:05:14.307832 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 643/1265] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:05:13 2021] DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/9bfd103a-1fc5-40d0-985a-0a1f8f5599b0 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:14.313650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:14.314768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:14.322386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:14.322386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:14.322711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:14.323091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:14.401308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1439e202-ae30-45b6-9cd4-4cc541e4d633 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.091959 Dec 16 18:05:14.403202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 644/1266] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:14 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:14.480303 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5020b8ca-d00b-4493-ac15-fc988cc591b4 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action" status: 202 len: 0 microversion: 2.1 time: 0.516342 Dec 16 18:05:14.483014 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-b2f8299c-7e74-4fe5-ad61-0c1dbdf5da0b req-0f19ffb5-5ecd-4f82-8b89-9e65e7170bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:14.484982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:05:14.484982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:05:14.488329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 623/1267] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Dec 16 18:05:13 2021] POST /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:14.512560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b2f8299c-7e74-4fe5-ad61-0c1dbdf5da0b req-0f19ffb5-5ecd-4f82-8b89-9e65e7170bd5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:14.517113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-b2f8299c-7e74-4fe5-ad61-0c1dbdf5da0b req-0f19ffb5-5ecd-4f82-8b89-9e65e7170bd5 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:14.541766 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-b2f8299c-7e74-4fe5-ad61-0c1dbdf5da0b req-0f19ffb5-5ecd-4f82-8b89-9e65e7170bd5 service nova] Creating event network-changed:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:05:14.548307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-b2f8299c-7e74-4fe5-ad61-0c1dbdf5da0b req-0f19ffb5-5ecd-4f82-8b89-9e65e7170bd5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069743 Dec 16 18:05:14.549727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 645/1268] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:05:15.415791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:15.417860 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:15.425942 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:15.426853 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:15.428542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:15.429478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:15.494647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-562e3f41-492e-4447-9ce3-f172d612c56e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.084168 Dec 16 18:05:15.495392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 624/1269] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:15 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:15.826752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:05:15.826752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:05:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:05:16.179098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:16.179667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:16.186072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.186515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.187311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.187734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.269308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lazy-loading 'services' on Instance uuid 388f8928-1248-47df-95b1-4c7030d1ccf0 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:05:16.343671 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5e73c004-8b3b-4632-93db-5050d01b2981 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments/3da39074-a8ef-441b-8ac8-c831ff350f48" status: 202 len: 0 microversion: 2.1 time: 0.169224 Dec 16 18:05:16.344252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 646/1270] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:05:16 2021] DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments/3da39074-a8ef-441b-8ac8-c831ff350f48 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:16.353651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:16.355321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:16.363201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.363654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.364457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.364922 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.398747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d0dd6f3e-575e-4efb-99c8-878615671f6d tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Dec 16 18:05:16.399610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 625/1271] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:16 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:05:16.497702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:16.498291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:16.505979 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.506753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.507745 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.507875 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:16.508820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.508948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:16.515520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.516070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.516964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.517464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.542270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aee77885-49d6-455d-8e79-db6609773a2e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/4b990e81-b9f1-4d85-a822-ed1d1fb1ce09" status: 200 len: 194 microversion: 2.1 time: 0.048780 Dec 16 18:05:16.543092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 647/1272] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Dec 16 18:05:16 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/4b990e81-b9f1-4d85-a822-ed1d1fb1ce09 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:05:16.552870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:16.553356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:16.559812 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.560274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.561054 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.561490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.580575 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6dc8a48b-78cd-4dbd-9361-029d92be38ea tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.076870 Dec 16 18:05:16.581324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 626/1273] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:16 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:16.588543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-00a5bf1f-53ae-4bbd-986d-cb28cdcdb5d7 req-81b2b733-ab15-4d4d-8e86-f775edcfcee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:16.590161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:05:16.590161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:05:16.599330 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-00a5bf1f-53ae-4bbd-986d-cb28cdcdb5d7 req-81b2b733-ab15-4d4d-8e86-f775edcfcee2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:16.599934 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-00a5bf1f-53ae-4bbd-986d-cb28cdcdb5d7 req-81b2b733-ab15-4d4d-8e86-f775edcfcee2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:16.616526 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-00a5bf1f-53ae-4bbd-986d-cb28cdcdb5d7 req-81b2b733-ab15-4d4d-8e86-f775edcfcee2 service nova] Creating event network-changed:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:05:16.622126 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-00a5bf1f-53ae-4bbd-986d-cb28cdcdb5d7 req-81b2b733-ab15-4d4d-8e86-f775edcfcee2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037910 Dec 16 18:05:16.622842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 627/1274] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:05:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:16.650802 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.objects.instance [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lazy-loading 'services' on Instance uuid 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 {{(pid=115914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:05:16.724480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2e102b3d-58ad-4780-baed-915c8ea58be1 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/4b990e81-b9f1-4d85-a822-ed1d1fb1ce09" status: 202 len: 0 microversion: 2.1 time: 0.175436 Dec 16 18:05:16.725856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 648/1275] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:05:16 2021] DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments/4b990e81-b9f1-4d85-a822-ed1d1fb1ce09 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:17.415408 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:17.416793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:17.426407 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.427097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.427897 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.428350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.460982 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5874d9f6-2d44-4574-a043-53a3f973cdd0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052523 Dec 16 18:05:17.461543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 628/1276] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:17 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:05:17.474392 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:17.475003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:17.483402 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.483824 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.485361 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.485533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.572321 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] HTTP exception thrown: Instance 388f8928-1248-47df-95b1-4c7030d1ccf0 is not attached to volume 3da39074-a8ef-441b-8ac8-c831ff350f48 Dec 16 18:05:17.572939 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Returning 404 to user: Instance 388f8928-1248-47df-95b1-4c7030d1ccf0 is not attached to volume 3da39074-a8ef-441b-8ac8-c831ff350f48 {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:17.573806 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5e59e3fe-2518-41b6-9876-65657971e0e3 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments/3da39074-a8ef-441b-8ac8-c831ff350f48" status: 404 len: 154 microversion: 2.1 time: 0.105233 Dec 16 18:05:17.575624 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 649/1277] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Dec 16 18:05:17 2021] DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0/os-volume_attachments/3da39074-a8ef-441b-8ac8-c831ff350f48 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:17.598417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:17.599602 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:17.606379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.606876 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.607684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.608113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.683932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b2aedfd4-1c4f-4ab7-9968-8caf96fbf093 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.093418 Dec 16 18:05:17.684599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 629/1278] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:17 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:17.906343 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:17.907342 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:17.913678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.914132 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.914943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:17.915378 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:17.946752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5928873d-b566-4dc9-a722-beb738aa72f8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044429 Dec 16 18:05:17.947308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 650/1279] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:17 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:05:18.061572 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:18.061572 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.069299 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.069750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.070698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.071052 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.105683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fa584212-7da0-4b69-b61f-960465cc26fe tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049346 Dec 16 18:05:18.106169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 630/1280] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Dec 16 18:05:18 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 18:05:18.171769 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:18.172501 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.181710 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.183466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.183466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.184021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.215691 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:05:18.318107 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-025b1919-45f3-457a-950b-dec8bf7da56e tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 204 len: 0 microversion: 2.1 time: 0.152039 Dec 16 18:05:18.318750 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 651/1281] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:05:18 2021] DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:05:18.329457 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:18.330201 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.339451 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.339898 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.340684 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.341116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.489948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:18.499647 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0189b9b3-7fdc-4b12-afad-ae654f536afc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1674 microversion: 2.1 time: 0.175925 Dec 16 18:05:18.500437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 631/1282] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:18 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:05:18.697622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:18.698561 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.709096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.709653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.710453 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.710971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.731398 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:18.731987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.738932 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.739478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.740274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.740709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.773531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:05:18.784314 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9f2c633b-497c-41ad-88ac-f4ef4cb1abbc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.090863 Dec 16 18:05:18.785088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 652/1283] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:18 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:18.863509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0382b36c-aa90-4531-9513-16b26c0a8947 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 204 len: 0 microversion: 2.1 time: 0.135618 Dec 16 18:05:18.864846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 632/1284] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:05:18 2021] DELETE /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:05:18.873757 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:18.874489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:18.882055 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.882506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:18.883335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:18.883772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:19.029627 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:19.038946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-679e595a-dda5-4436-b677-1892365f9191 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1552 microversion: 2.1 time: 0.169035 Dec 16 18:05:19.039685 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 653/1285] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:18 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:05:19.518323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:19.519051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:19.531351 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:19.532444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:19.533226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:19.533655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:19.681977 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:19.692494 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e86856e4-9967-4f96-a34d-28c26de064d8 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1674 microversion: 2.1 time: 0.178462 Dec 16 18:05:19.693286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 633/1286] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:19 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:05:19.800095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:19.801390 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:19.811673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:19.812358 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:19.813495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:19.814119 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:19.884017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a5e07150-fe85-4d3f-8361-c6027f8b92ab tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.089356 Dec 16 18:05:19.884670 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 654/1287] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:19 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:20.060578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:20.061149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:20.070288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.070755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.071543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.071963 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.221642 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:20.234062 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-11642709-b2b7-47eb-8a9a-334863039fb7 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1552 microversion: 2.1 time: 0.178854 Dec 16 18:05:20.235467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 634/1288] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:20 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:05:20.709981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:20.710918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:20.718550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.719025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.719889 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.720325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.860501 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5ac7db630e4c49b74b92b067adc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b338079c744874b26565ecd0d93596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:20.869653 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-dd870d63-bc0a-45b6-a91a-e3eab0291ddc tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 200 len: 1674 microversion: 2.1 time: 0.163679 Dec 16 18:05:20.870451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 655/1289] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:20 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:05:20.896211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:20.897155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:20.911312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.911769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.912811 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:20.913445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:20.981270 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-19dc47ea-5945-4e1f-800c-7850fc8dd779 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.088604 Dec 16 18:05:20.985464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 635/1290] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:20 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:21.206641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-09c81c66-43a0-466c-ab53-5b475dc9fc8d req-6f121f26-fb63-4cc8-955a-e6eda7a943b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baf3ec0-6bf3-4ec7-93ce-46d3471c9984", "name": "network-vif-deleted", "tag": "8d32b2ae-696c-4691-9736-3ca1147eff32"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:21.209102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:05:21.209102 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:05:21.232924 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-09c81c66-43a0-466c-ab53-5b475dc9fc8d req-6f121f26-fb63-4cc8-955a-e6eda7a943b2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.233285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-09c81c66-43a0-466c-ab53-5b475dc9fc8d req-6f121f26-fb63-4cc8-955a-e6eda7a943b2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.258121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-09c81c66-43a0-466c-ab53-5b475dc9fc8d req-6f121f26-fb63-4cc8-955a-e6eda7a943b2 service nova] Creating event network-vif-deleted:8d32b2ae-696c-4691-9736-3ca1147eff32 for instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 on hv-cinder-81920 Dec 16 18:05:21.267178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-09c81c66-43a0-466c-ab53-5b475dc9fc8d req-6f121f26-fb63-4cc8-955a-e6eda7a943b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064079 Dec 16 18:05:21.267948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:21.268474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 656/1291] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:05:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:21.271327 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:21.282786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.283868 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.285478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.286102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.513381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dad1fd17242e4ae9aecd40a9029be1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15f37c1016f4bf69ab6e241b39cbefb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:21.521180 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4ed07d17-e8f6-44bc-a46b-7330f7729c2c tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 200 len: 1552 microversion: 2.1 time: 0.266409 Dec 16 18:05:21.521962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 636/1292] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:21 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 1552 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:05:21.546325 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-73fe0a49-c04a-489f-a717-eda662a8d24d req-3567e202-f8bc-4008-9aca-e29aebe742e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388f8928-1248-47df-95b1-4c7030d1ccf0", "name": "network-vif-deleted", "tag": "247f1d20-fafa-49b7-8f54-d1ff1a3dcb72"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:21.550558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:05:21.550558 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:05:21.560567 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-73fe0a49-c04a-489f-a717-eda662a8d24d req-3567e202-f8bc-4008-9aca-e29aebe742e2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.561058 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-73fe0a49-c04a-489f-a717-eda662a8d24d req-3567e202-f8bc-4008-9aca-e29aebe742e2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.573554 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-73fe0a49-c04a-489f-a717-eda662a8d24d req-3567e202-f8bc-4008-9aca-e29aebe742e2 service nova] Creating event network-vif-deleted:247f1d20-fafa-49b7-8f54-d1ff1a3dcb72 for instance 388f8928-1248-47df-95b1-4c7030d1ccf0 on hv-cinder-81920 Dec 16 18:05:21.578147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-73fe0a49-c04a-489f-a717-eda662a8d24d req-3567e202-f8bc-4008-9aca-e29aebe742e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039904 Dec 16 18:05:21.578982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 657/1293] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:05:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:21.886674 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:21.887280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:21.894209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.894660 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.895642 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:21.896236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:21.910519 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. Dec 16 18:05:21.911146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:21.911981 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-23ccd84e-2c99-4052-b083-e98f475ba78a tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 404 len: 111 microversion: 2.1 time: 0.029125 Dec 16 18:05:21.912545 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 637/1294] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:21 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:21.921749 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-2601e445-c3c3-40af-a6f5-cbcfe203542b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '.version_select at 0x7fca1c4b2790>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:21.955694 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-2601e445-c3c3-40af-a6f5-cbcfe203542b tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479435857" status: 202 len: 0 microversion: 2.1 time: 0.031554 Dec 16 18:05:21.960888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 658/1295] 10.222.0.32 () {58 vars in 1220 bytes} [Thu Dec 16 18:05:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479435857 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:21.993676 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:21.994652 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:22.005016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:22.005386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:22.011240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:22.011713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:22.080679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d04f6220-4203-4a6d-9086-8916cd24c05b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.090852 Dec 16 18:05:22.081266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 638/1296] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:21 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:22.539543 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:22.540550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] [instance: 388f8928-1248-47df-95b1-4c7030d1ccf0] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:22.548343 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:22.548755 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:22.549846 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:22.550467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:22.566674 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] HTTP exception thrown: Instance 388f8928-1248-47df-95b1-4c7030d1ccf0 could not be found. Dec 16 18:05:22.567395 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Returning 404 to user: Instance 388f8928-1248-47df-95b1-4c7030d1ccf0 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:22.568158 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1b27f40e-6615-4639-b9eb-8d8b08fab3c0 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0" status: 404 len: 111 microversion: 2.1 time: 0.033050 Dec 16 18:05:22.568739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 659/1297] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:22 2021] GET /compute/v2.1/servers/388f8928-1248-47df-95b1-4c7030d1ccf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:22.578344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-80f7f613-ee39-4360-b8ff-033cad509c61 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] Calling method '.version_select at 0x7fca1774f3a0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:22.599280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-80f7f613-ee39-4360-b8ff-033cad509c61 tempest-TestMinimumBasicScenario-274312541 tempest-TestMinimumBasicScenario-274312541-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371199625" status: 202 len: 0 microversion: 2.1 time: 0.025030 Dec 16 18:05:22.599899 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 639/1298] 10.222.0.32 () {58 vars in 1268 bytes} [Thu Dec 16 18:05:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371199625 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:23.092930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:23.093853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:23.100171 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:23.100605 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:23.101954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:23.102339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:23.167466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cb6ed185-27be-42d6-b280-d15fcd12c4b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.078713 Dec 16 18:05:23.168142 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 660/1299] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:23 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:24.181025 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:24.182074 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:24.190947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:24.191959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:24.192768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:24.193209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:24.266066 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-aa4a8918-3d8d-4ae9-b0ef-a4f3fd349f98 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28647 microversion: 2.20 time: 0.089950 Dec 16 18:05:24.266943 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 640/1300] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:24 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28647 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:24.969510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:24.970091 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:24.977786 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:24.978237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:24.979073 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:24.979513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:24.994852 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. Dec 16 18:05:24.995443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:24.996286 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-edbf99a7-5f43-4a2a-9ae6-fbf78e78a6ef tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 404 len: 111 microversion: 2.1 time: 0.030957 Dec 16 18:05:24.996838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 661/1301] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:05:24 2021] DELETE /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 18:05:25.005577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:25.006272 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:25.013500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:25.013944 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:25.014755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:25.015181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:25.035403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. Dec 16 18:05:25.035990 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:25.037040 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1d0bc051-efa8-4435-8464-46b8c69483ed tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984" status: 404 len: 111 microversion: 2.1 time: 0.035650 Dec 16 18:05:25.037588 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 641/1302] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:25 2021] GET /compute/v2.1/servers/1baf3ec0-6bf3-4ec7-93ce-46d3471c9984 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:25.280301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:25.281734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:25.289223 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:25.290103 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:25.290892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:25.291485 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:25.396019 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ae58f216-ccc0-4453-91c7-e034e51a5cb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 28766 microversion: 2.20 time: 0.120013 Dec 16 18:05:25.396719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 662/1303] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:25 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 28766 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:26.182240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:26.182865 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:26.190215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.190679 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.191887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.192540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.209509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. Dec 16 18:05:26.210849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:26.212394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3dfda08a-da6b-4f8f-8d7b-bfd25fb59230 tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 404 len: 111 microversion: 2.1 time: 0.034134 Dec 16 18:05:26.213197 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 642/1304] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:05:26 2021] DELETE /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:26.222277 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:26.223092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] [instance: 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:26.230157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.230746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.231606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.232280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.255362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] HTTP exception thrown: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. Dec 16 18:05:26.256210 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] Returning 404 to user: Instance 6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:26.257267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c25401e4-0834-4bfd-86e7-d1784b796cee tempest-AttachVolumeTestJSON-520543518 tempest-AttachVolumeTestJSON-520543518-project] 10.222.0.32 "GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39" status: 404 len: 111 microversion: 2.1 time: 0.039220 Dec 16 18:05:26.257978 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 663/1305] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:05:26 2021] GET /compute/v2.1/servers/6e6bc622-be3a-4c87-90e5-80f6bf9f4d39 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:26.407474 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:26.408485 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:26.415227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.415895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.416948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:26.417530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:26.505255 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0bfc801a-8bb7-47ee-ba17-f31ac1f41f83 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 30895 microversion: 2.20 time: 0.101243 Dec 16 18:05:26.506287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 643/1306] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:26 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 30895 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:27.517793 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:27.518959 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:27.526474 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:27.527040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:27.527903 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:27.528460 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:27.610028 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5059a498-61be-4366-8bcb-72efd50a29b1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 32565 microversion: 2.20 time: 0.095809 Dec 16 18:05:27.611747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 664/1307] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:27 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 32565 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:28.623361 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:28.625064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:28.633098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:28.633852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:28.634891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:28.635314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:28.726564 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1480c881-0fd8-4e73-850d-2bea12619ee4 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 33547 microversion: 2.20 time: 0.107066 Dec 16 18:05:28.727916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 644/1308] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:28 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 33547 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:29.739882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:29.741510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:29.748540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:29.748985 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:29.749980 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:29.750467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:29.823854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-50653dd2-4cf5-4eb7-9b08-092d1f25c84e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 34870 microversion: 2.20 time: 0.088037 Dec 16 18:05:29.825416 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 665/1309] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:29 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 34870 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:30.840583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:30.842191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:30.859887 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:30.860342 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:30.865468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:30.865814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:30.955730 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c10dd6e9-5086-4a36-9ec2-1045a066409c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 36431 microversion: 2.20 time: 0.120690 Dec 16 18:05:30.957957 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 645/1310] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:30 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 36431 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:31.893581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0c514ca5-984b-4bb7-9a7a-6eb2d1bd55fc tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Action: 'create', calling method: .version_select at 0x7fca1c27a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1075628950"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:31.969187 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:31.971144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:31.979144 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:31.980006 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:31.981084 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:31.981769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:32.065590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a6b5abdf-78f2-4841-bd6f-a85e17f17130 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 37990 microversion: 2.20 time: 0.100419 Dec 16 18:05:32.071542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 646/1311] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:31 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 37990 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 18:05:32.230718 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0c514ca5-984b-4bb7-9a7a-6eb2d1bd55fc tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.491316 Dec 16 18:05:32.231640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 666/1312] 10.222.0.32 () {60 vars in 1154 bytes} [Thu Dec 16 18:05:31 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 493 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 18:05:32.243213 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e71646f5-ea5a-4dae-8579-202b55bdb2f2 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c199ca0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:32.514512 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e71646f5-ea5a-4dae-8579-202b55bdb2f2 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 200 len: 345 microversion: 2.1 time: 0.275670 Dec 16 18:05:32.515123 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 647/1313] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 18:05:32 2021] GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:33.082394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:33.083804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:33.091789 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:33.092233 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:33.093007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:33.093407 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:33.179040 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-03385b90-2139-448b-acec-bd6be49e085e tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 38202 microversion: 2.20 time: 0.103422 Dec 16 18:05:33.179754 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 667/1314] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:33 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 38202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:33.529979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-861cbbbe-d8d3-4cef-bc69-e55f37eba4e0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c463b80>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:33.591355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-861cbbbe-d8d3-4cef-bc69-e55f37eba4e0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 200 len: 346 microversion: 2.1 time: 0.066512 Dec 16 18:05:33.592234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 648/1315] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 18:05:33 2021] GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:33.605297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a198b040-057e-47b6-9df2-190d7595d186 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Action: 'create', calling method: .version_select at 0x7fca1c286d30>, body: {"snapshot": {"volume_id": "0b41ef42-3d43-4664-b314-610882c14e55", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-858534605"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:33.779072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a198b040-057e-47b6-9df2-190d7595d186 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.178474 Dec 16 18:05:33.779661 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 668/1316] 10.222.0.32 () {60 vars in 1161 bytes} [Thu Dec 16 18:05:33 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:33.790108 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d7a1a199-0f51-4b1a-8947-20004d932036 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c407b80>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:33.821373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d7a1a199-0f51-4b1a-8947-20004d932036 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.035202 Dec 16 18:05:33.822068 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 649/1317] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:33 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:33.833110 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0f19ca44-6bfb-4cbb-b684-af6bb52f9f27 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c173ee0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:33.868747 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0f19ca44-6bfb-4cbb-b684-af6bb52f9f27 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039974 Dec 16 18:05:33.869318 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 669/1318] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Dec 16 18:05:33 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:33.883033 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f287a47b-1449-44a2-9626-595e7726f4fb tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c146160>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:33.917925 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f287a47b-1449-44a2-9626-595e7726f4fb tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.040058 Dec 16 18:05:33.918482 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 650/1319] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:33 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:34.194548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:34.196001 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:34.203648 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:34.204093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:34.204887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:34.205320 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:34.934783 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d10feae7-f96c-490b-b299-8b784d130481 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c407280>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:34.970182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d10feae7-f96c-490b-b299-8b784d130481 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.041939 Dec 16 18:05:34.970976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 651/1320] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:34 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:35.987724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ab16ec12-fc0d-4bbd-8e61-7d1f6d6ae8d9 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c199af0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:36.019850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ab16ec12-fc0d-4bbd-8e61-7d1f6d6ae8d9 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.038904 Dec 16 18:05:36.020414 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 652/1321] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:35 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:37.036862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-82ffa297-922f-414a-bf26-e60286f5cc71 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c190280>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:37.078791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-82ffa297-922f-414a-bf26-e60286f5cc71 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.048943 Dec 16 18:05:37.079364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 653/1322] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:37 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:37.637254 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-23898a0c-6733-4a86-97e8-93a65bbc85cf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 38202 microversion: 2.20 time: 3.446935 Dec 16 18:05:37.638155 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 670/1323] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:34 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 38202 bytes in 3449 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:38.093386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1a9509ce-6c60-46c0-bc6c-5e7e5c644778 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c4073a0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:38.123373 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1a9509ce-6c60-46c0-bc6c-5e7e5c644778 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 287 microversion: 2.1 time: 0.035287 Dec 16 18:05:38.123937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 654/1324] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:38 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:38.134493 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d3525a4e-ae90-4dd2-ae96-b8360462e465 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c18ce50>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:38.193758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d3525a4e-ae90-4dd2-ae96-b8360462e465 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 202 len: 0 microversion: 2.1 time: 0.063160 Dec 16 18:05:38.194322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 671/1325] 10.222.0.32 () {58 vars in 1253 bytes} [Thu Dec 16 18:05:38 2021] DELETE /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:38.202543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4cf803e7-5298-4711-a1c7-a48200707fc6 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c1d61f0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:38.231880 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4cf803e7-5298-4711-a1c7-a48200707fc6 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 200 len: 286 microversion: 2.1 time: 0.033043 Dec 16 18:05:38.232427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 655/1326] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:38 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:38.651070 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:38.652274 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:38.659692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:38.660143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:38.660941 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:38.661375 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:38.722834 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3b73913c-dc20-49e5-b950-5794f1774d07 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 38202 microversion: 2.20 time: 0.076017 Dec 16 18:05:38.723538 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 672/1327] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:38 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 38202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:39.249225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-72d6c237-fd78-4c53-b9d5-352da4840df8 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c192c10>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:39.278311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-72d6c237-fd78-4c53-b9d5-352da4840df8 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] HTTP exception thrown: Snapshot 917f73d1-1561-42cd-b18a-fe6106746994 could not be found. Dec 16 18:05:39.278979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-72d6c237-fd78-4c53-b9d5-352da4840df8 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Returning 404 to user: Snapshot 917f73d1-1561-42cd-b18a-fe6106746994 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:39.279846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-72d6c237-fd78-4c53-b9d5-352da4840df8 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994" status: 404 len: 111 microversion: 2.1 time: 0.038196 Dec 16 18:05:39.280396 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 656/1328] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Dec 16 18:05:39 2021] GET /compute/v2.1/os-snapshots/917f73d1-1561-42cd-b18a-fe6106746994 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:39.289259 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-22420e19-c0f5-404d-90f4-f359426fa729 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c187430>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:39.353101 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-22420e19-c0f5-404d-90f4-f359426fa729 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 202 len: 0 microversion: 2.1 time: 0.067933 Dec 16 18:05:39.353934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 673/1329] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 18:05:39 2021] DELETE /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:39.365520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-cf119730-7d07-4f47-9668-c3ff3cc767ec tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c199550>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:39.416046 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-cf119730-7d07-4f47-9668-c3ff3cc767ec tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 200 len: 345 microversion: 2.1 time: 0.056515 Dec 16 18:05:39.416589 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 657/1330] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 18:05:39 2021] GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:05:39.741253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:39.742919 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:39.751765 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:39.752207 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:39.753004 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:39.753462 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:39.828658 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-68e5486a-09ed-4ed4-856c-db0d614692bf tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 200 len: 38343 microversion: 2.20 time: 0.095407 Dec 16 18:05:39.829239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 674/1331] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:39 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 38343 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:05:39.839791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:39.840394 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:39.848166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:39.848593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:39.849403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:39.849833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:39.874501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dd9631c1-d2a4-4a3f-805d-a8abe00120de tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.038839 Dec 16 18:05:39.875096 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 658/1332] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Dec 16 18:05:39 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:05:40.429857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-907bec6d-6c0a-47ea-8e56-2d02855d09f0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c0b2ee0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:40.460044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-907bec6d-6c0a-47ea-8e56-2d02855d09f0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] HTTP exception thrown: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. Dec 16 18:05:40.460632 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-907bec6d-6c0a-47ea-8e56-2d02855d09f0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Returning 404 to user: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:40.461506 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-907bec6d-6c0a-47ea-8e56-2d02855d09f0 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 404 len: 109 microversion: 2.1 time: 0.035884 Dec 16 18:05:40.462428 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 675/1333] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 18:05:40 2021] GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:40.478831 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-da2b9566-55f5-4586-9bc2-c77d358f57e3 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c1a9790>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:40.508814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-da2b9566-55f5-4586-9bc2-c77d358f57e3 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] HTTP exception thrown: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. Dec 16 18:05:40.509421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-da2b9566-55f5-4586-9bc2-c77d358f57e3 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Returning 404 to user: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:40.510258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-da2b9566-55f5-4586-9bc2-c77d358f57e3 tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 404 len: 109 microversion: 2.1 time: 0.036947 Dec 16 18:05:40.510838 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 659/1334] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Dec 16 18:05:40 2021] DELETE /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:40.522413 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8637c46c-467a-4dbe-98a1-e0feaf8c8cbd tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Calling method '.version_select at 0x7fca1c2a80d0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:40.555180 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-8637c46c-467a-4dbe-98a1-e0feaf8c8cbd tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] HTTP exception thrown: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. Dec 16 18:05:40.556175 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8637c46c-467a-4dbe-98a1-e0feaf8c8cbd tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] Returning 404 to user: Volume 0b41ef42-3d43-4664-b314-610882c14e55 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:05:40.557525 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8637c46c-467a-4dbe-98a1-e0feaf8c8cbd tempest-VolumesSnapshotsTestJSON-355826881 tempest-VolumesSnapshotsTestJSON-355826881-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55" status: 404 len: 109 microversion: 2.1 time: 0.040385 Dec 16 18:05:40.558353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 676/1335] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Dec 16 18:05:40 2021] GET /compute/v2.1/os-volumes/0b41ef42-3d43-4664-b314-610882c14e55 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:05:42.047366 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:05:42.049206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:42.057978 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:42.058409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:42.059294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:42.059755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:42.084969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.objects.instance [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lazy-loading 'flavor' on Instance uuid b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 {{(pid=115915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 18:05:42.365820 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e784ff4c-e5e1-4999-a160-c0b0a4ea0098 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 202 len: 0 microversion: 2.20 time: 0.326124 Dec 16 18:05:42.367275 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 660/1336] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:05:42 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:05:42.376373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:42.377137 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:42.384607 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:42.385050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:42.385937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:42.386386 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:42.558899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:42.569208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:42.570884 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:42.572349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-def3758d-d322-4489-bedd-3a4f8e3c7cb9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.201482 Dec 16 18:05:42.573315 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 677/1337] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:42 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:43.594781 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:43.595478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:43.602350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:43.602822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:43.603593 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:43.604038 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:43.741832 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:43.750478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:43.752013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:43.753207 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-28e2dfa7-652e-4a99-94f9-c19ee974c0a3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.163625 Dec 16 18:05:43.753764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 661/1338] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:43 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:44.771612 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:44.772303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:44.779270 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:44.779798 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:44.780722 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:44.781221 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:44.920161 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:44.929300 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:44.930835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:44.932022 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f8ef9a2c-4833-4f25-a406-447cb16a1584 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.164230 Dec 16 18:05:44.932844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 678/1339] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:44 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:45.951539 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:45.952316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:45.959533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:45.960013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:45.960834 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:45.961753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:46.103633 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:46.117331 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:46.118715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:46.119969 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-105c20ae-53cd-40cc-a600-58ce5e408701 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.172423 Dec 16 18:05:46.120610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 662/1340] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:45 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:47.137491 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:47.138189 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:47.145322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:47.145770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:47.146576 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:47.147279 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:47.343317 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:47.353504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:47.355288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:47.356626 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ca6e4fe7-c9bb-44c0-bc7c-3cb05d5398fc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.223053 Dec 16 18:05:47.357206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 679/1341] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:47 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:48.375641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:48.376244 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:48.382646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:48.383113 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:48.383895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:48.384325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:48.522486 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:48.530833 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:48.532337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:48.533553 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c3c65862-e62f-497b-b026-fc3a7b292c86 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.161700 Dec 16 18:05:48.534092 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 663/1342] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:48 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:49.553142 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:49.553726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:49.560739 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:49.561877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:49.562775 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:49.563215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:49.732184 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:49.740894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:49.742373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:49.743565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-654f319e-36ef-4460-a7bf-580de447c04b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.194338 Dec 16 18:05:49.744133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 680/1343] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:49 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:50.764353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:50.765031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:50.772359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:50.772794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:50.773587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:50.774010 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:50.908794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:50.917445 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:50.918979 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:50.920215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7f39cd01-dc7f-4f83-8276-ef49727cdce1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.159850 Dec 16 18:05:50.920800 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 664/1344] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:50 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:51.938979 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:51.939568 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:51.946527 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:51.947007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:51.947800 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:51.948245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:52.091272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:52.099619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:52.101113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:52.102313 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-02ae6fe4-262b-453a-a661-e2c9e88fded5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.167295 Dec 16 18:05:52.102917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 681/1345] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:51 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:53.121148 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:53.121752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:53.129937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:53.130682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:53.131902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:53.132339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:53.268900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:53.277298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:53.278807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:53.280340 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8fd2ba17-d5ab-4751-98e3-623b8eb4159f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.162647 Dec 16 18:05:53.281081 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 665/1346] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:53 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:54.300077 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:54.300692 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:54.307499 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:54.307946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:54.308756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:54.309191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:54.456282 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:54.469328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:54.470866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:54.472048 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4a0d3b5f-cd24-4486-8280-9e3605cb82af tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.175987 Dec 16 18:05:54.472611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 682/1347] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:54 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:55.496631 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:55.497262 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:55.505353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:55.505897 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:55.507106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:55.507713 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:55.651443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:55.660180 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:55.661682 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:55.662949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5a1f4b5b-b025-44d0-a840-0cde7aab57c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.170517 Dec 16 18:05:55.663498 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 666/1348] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:55 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:56.681549 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:56.682484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:56.690976 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:56.691399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:56.692178 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:56.692608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:56.845209 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:56.855396 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:56.856894 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:56.858183 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7eee1ca6-032e-4c2f-a5d7-16a2260173ba tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.180376 Dec 16 18:05:56.858772 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 683/1349] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:56 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:57.879852 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:57.880966 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:57.892048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:57.892829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:57.894372 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:57.895171 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:58.056166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:58.064666 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:58.066152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:58.067339 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ef7db32d-708a-48e3-ac34-479ce1a08a04 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.193627 Dec 16 18:05:58.067900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 667/1350] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:57 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:05:59.086044 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:05:59.087023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:05:59.094135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:59.094776 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:59.095830 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:05:59.096253 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:05:59.248369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:59.256944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:59.258486 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:05:59.259700 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-da210808-5477-4e58-b486-e25df8fa69c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.177508 Dec 16 18:05:59.260308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 684/1351] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:05:59 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:00.282353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:00.283034 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:00.289841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:00.290355 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:00.291234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:00.291675 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:00.439326 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:00.447902 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:00.449427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:00.450610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ba878e9e-6bba-45f1-9a2d-fe0a330d6df5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.174418 Dec 16 18:06:00.451204 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 668/1352] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:00 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:01.469571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:01.470186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:01.476957 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:01.477399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:01.478172 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:01.478595 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:01.631994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:01.649003 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:01.650510 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:01.651746 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-17453172-1d0d-4ddb-ba21-812063abd047 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.186004 Dec 16 18:06:01.652331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 685/1353] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:01 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:06:02.674400 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:02.675065 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:02.681846 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:02.682290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:02.683124 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:02.683585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:02.834610 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:02.842808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:02.844417 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:02.845592 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f1352671-2f72-4c6d-8b7b-8d3d34db217b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.175069 Dec 16 18:06:02.846209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 669/1354] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:02 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:03.864484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:03.865093 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:03.873775 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:03.874374 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:03.875662 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:03.875837 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:04.021146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:04.029056 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:04.030693 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:04.031885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5433194e-f1ed-49e9-9a7c-6e6ef1be7d9a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.171785 Dec 16 18:06:04.032451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 686/1355] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:03 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:05.055213 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:05.055863 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:05.063391 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:05.063844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:05.064864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:05.065439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:05.216983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:05.229359 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:05.231665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:05.233397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d379f29b-cc15-4478-b6b0-918f890bf18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.183430 Dec 16 18:06:05.234218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 670/1356] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:05 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:06.253126 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:06.253808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:06.261622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:06.262041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:06.263085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:06.263548 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:06.405363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:06.414640 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:06.416125 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:06.417288 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-8cae3a16-4232-4884-a5fe-11be0fc850e0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.168536 Dec 16 18:06:06.417838 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 687/1357] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:06 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:07.436031 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:07.436671 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:07.443240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:07.443674 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:07.444466 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:07.444895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:07.596023 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:07.604793 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:07.606283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:07.607496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ed775a73-b927-4cf1-a33e-74b2e27ef6c6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.175597 Dec 16 18:06:07.608063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 671/1358] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:07 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:08.444897 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-92a10015-3903-451b-be22-c2f4a1f36079 req-8e2065b4-4c6b-4c60-ae14-06a7748a4392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "name": "network-vif-plugged", "status": "completed", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:06:08.446470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:06:08.446470 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:06:08.454307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-92a10015-3903-451b-be22-c2f4a1f36079 req-8e2065b4-4c6b-4c60-ae14-06a7748a4392 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:08.455034 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-92a10015-3903-451b-be22-c2f4a1f36079 req-8e2065b4-4c6b-4c60-ae14-06a7748a4392 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:08.467356 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-92a10015-3903-451b-be22-c2f4a1f36079 req-8e2065b4-4c6b-4c60-ae14-06a7748a4392 service nova] Creating event network-vif-plugged:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:06:08.473165 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-92a10015-3903-451b-be22-c2f4a1f36079 req-8e2065b4-4c6b-4c60-ae14-06a7748a4392 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Dec 16 18:06:08.473770 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 688/1359] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:06:08.626985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:08.627699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:08.635007 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:08.635630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:08.636246 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:08.636719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:08.795181 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:08.804116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:08.805625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:08.806861 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-66aaffcc-cf88-407a-894a-7fd65e8fca99 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.184335 Dec 16 18:06:08.807420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 672/1360] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:08 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:09.828192 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:09.829268 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:09.835573 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:09.836634 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:09.837521 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:09.837948 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:10.006399 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:10.014928 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:10.016463 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:10.017682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0813b1c3-cb18-4627-9a57-631dce3568d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1743 microversion: 2.20 time: 0.195083 Dec 16 18:06:10.018193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 689/1361] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:09 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:11.036765 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:11.037919 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:11.045481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:11.046243 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:11.047236 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:11.047816 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:11.253773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:11.267169 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:11.268964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:11.270608 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-723c697c-964b-4b1e-87a4-fa00c2718706 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.237892 Dec 16 18:06:11.271350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 673/1362] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:11 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:12.293925 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:12.295291 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:12.312345 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:12.313098 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:12.314763 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:12.315619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:12.487683 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:12.498913 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:12.500996 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:12.502322 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-bfb1aa8a-98bc-4bd4-9ecc-184c8d7d137f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.214305 Dec 16 18:06:12.503295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 690/1363] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:12 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:13.527965 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:13.529061 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:13.542235 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:13.542719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:13.543505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:13.543937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:13.727367 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:13.739286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:13.741691 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:13.743481 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e5d32631-182b-4046-81c4-9bfbb256cb91 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.219550 Dec 16 18:06:13.744558 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 674/1364] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:13 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:14.763733 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:14.764500 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:14.771241 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:14.772146 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:14.773067 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:14.773656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:14.949818 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:14.959719 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:14.961872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:14.963426 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c7856296-5824-4748-9aec-45bf4bfb36f0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.204051 Dec 16 18:06:14.964202 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 691/1365] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:14 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:06:15.983371 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:15.984690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:15.991950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:15.992644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:15.993432 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:15.993859 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:16.168769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:16.177797 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:16.180166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:16.181439 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-c94542f0-389b-472e-b271-6c17a25dd652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.202012 Dec 16 18:06:16.182076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 675/1366] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:15 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:17.201629 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:17.204023 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:17.222507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:17.222989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:17.223809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:17.224237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:17.396188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:17.406743 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:17.409061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:17.411111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a6ee34b8-96b0-474d-b21c-d709b6b29ddc tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.214246 Dec 16 18:06:17.422888 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 692/1367] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:17 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:18.429998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:18.431509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:18.437984 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:18.438433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:18.439252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:18.439688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:18.599415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:18.607935 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:18.609736 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:18.611240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-44f7729d-d940-497c-b852-290a889e3871 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.185049 Dec 16 18:06:18.612070 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 676/1368] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:18 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 18:06:19.630799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:19.631571 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:19.639950 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:19.643281 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:19.644559 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:19.645540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:19.811238 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:19.822804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:19.825052 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:19.826702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-233f6c61-5ee6-4fea-8959-236a6af6d97a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.200990 Dec 16 18:06:19.841303 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 693/1369] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:19 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:20.848160 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:20.849389 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:20.855517 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:20.855962 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:20.857032 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:20.857412 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:21.013477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:21.021916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:21.023435 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:21.024663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f1bccfd2-7cef-4f47-adb2-fd59867a6bb6 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1738 microversion: 2.20 time: 0.180886 Dec 16 18:06:21.025215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 677/1370] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:20 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:22.043660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:22.044280 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:22.051520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:22.051969 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:22.052755 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:22.053302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:22.209076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:22.217454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:22.219041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:22.220159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-41cb4af1-f85c-423a-bedf-0d02b425d8a7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1720 microversion: 2.20 time: 0.180593 Dec 16 18:06:22.220703 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 694/1371] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:22 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:23.240577 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:23.241182 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:23.250766 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:23.251397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:23.252672 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:23.253410 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:23.412822 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:23.423214 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:23.425450 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:23.427161 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6512161a-5315-4956-8ada-eade2864e7a8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1720 microversion: 2.20 time: 0.190226 Dec 16 18:06:23.427851 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 678/1372] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:23 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:24.450458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:24.451127 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:24.457835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:24.458304 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:24.459391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:24.459849 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:24.474821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-1f111675-d25a-4f20-992b-23e944de79f8 req-0b6002b2-cc17-4d8f-9280-86f58f9160be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "name": "network-vif-unplugged", "status": "completed", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:06:24.476917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:06:24.476917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:06:24.485532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1f111675-d25a-4f20-992b-23e944de79f8 req-0b6002b2-cc17-4d8f-9280-86f58f9160be service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:24.486276 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1f111675-d25a-4f20-992b-23e944de79f8 req-0b6002b2-cc17-4d8f-9280-86f58f9160be service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:24.501696 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.compute.server_external_events [req-1f111675-d25a-4f20-992b-23e944de79f8 req-0b6002b2-cc17-4d8f-9280-86f58f9160be service nova] Unable to find a host for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3. Dropping event network-vif-unplugged {{(pid=115915) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 18:06:24.502648 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-1f111675-d25a-4f20-992b-23e944de79f8 req-0b6002b2-cc17-4d8f-9280-86f58f9160be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031868 Dec 16 18:06:24.503234 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 679/1373] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 16 18:06:24.628720 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:24.636823 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:24.638305 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:24.639490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a00e6e59-e0a3-4e00-a7fa-3023bbdfdcde tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1663 microversion: 2.20 time: 0.193867 Dec 16 18:06:24.640046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 695/1374] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:24 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:24.659063 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e929c17-bdf5-4f35-be8c-da8c790d4c0e"}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:06:24.660491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:24.667948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:24.668442 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:24.669264 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:24.669733 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:24.994189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8c92802c-b308-46a3-b60a-a756004744ca tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.340239 Dec 16 18:06:24.994959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 680/1375] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Dec 16 18:06:24 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 18:06:25.130947 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:25.131507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:25.138899 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:25.139349 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:25.140139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:25.140572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:25.420577 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-9cc8a535-6274-454d-b3a0-08bd0e235d74 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments/1e929c17-bdf5-4f35-be8c-da8c790d4c0e" status: 202 len: 0 microversion: 2.20 time: 0.293771 Dec 16 18:06:25.421117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 696/1376] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Dec 16 18:06:25 2021] DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments/1e929c17-bdf5-4f35-be8c-da8c790d4c0e => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:06:25.478786 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:06:25.479390 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:25.486655 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:25.487095 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:25.487872 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:25.488283 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:25.594015 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [1c2673be-a565-4890-bb00-449d1f339bbd] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 18:06:26.610387 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [1c2673be-a565-4890-bb00-449d1f339bbd] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 42716. Dec 16 18:06:26.613936 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-30b84c3c-f214-4d0b-8821-77d2030ccf31 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action" status: 202 len: 0 microversion: 2.20 time: 1.139205 Dec 16 18:06:26.614538 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 681/1377] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Dec 16 18:06:25 2021] POST /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:06:26.622814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:26.623423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:26.630660 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:26.631211 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:26.632007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:26.632507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:26.781550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:26.797150 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:26.798740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:26.800185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c8160fdf-480a-4b32-9715-0dc5648d62f8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1671 microversion: 2.20 time: 0.181176 Dec 16 18:06:26.800840 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 697/1378] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:26 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:27.819000 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:27.819751 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:27.828452 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:27.828892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:27.829697 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:27.830124 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:27.972438 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:27.981145 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:27.983079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:27.984411 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-bbdfca41-5fc1-44b9-9412-831199fefabe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.169899 Dec 16 18:06:27.984948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 682/1379] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:27 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:29.011516 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:29.013502 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:29.020877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:29.021659 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:29.022484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:29.022984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:29.177230 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:29.189302 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:29.190930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:29.192186 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6e340b12-d638-48fa-82c1-f40c2bea60c0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.192867 Dec 16 18:06:29.192835 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 698/1380] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:28 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:30.212894 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:30.214203 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:30.229348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:30.229348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:30.229348 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:30.233989 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:30.384670 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:30.393607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:30.395281 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:30.396479 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1d63f614-9ce9-4924-8cff-bcb4669f936d tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.188476 Dec 16 18:06:30.397363 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 683/1381] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:30 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:31.416515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:31.417430 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:31.424424 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:31.424869 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:31.425676 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:31.426113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:31.575021 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:31.584244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:31.586405 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:31.587873 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1a5349cc-d024-4191-8a1c-d91983f6163b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.175309 Dec 16 18:06:31.588682 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 699/1382] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:31 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:32.605808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:32.606542 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:32.613828 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:32.614280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:32.615209 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:32.615663 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:32.766374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:32.774321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:32.775985 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:32.777325 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-49e81833-4e4c-42c0-948e-344a7673de5b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.175610 Dec 16 18:06:32.777996 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 684/1383] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:32 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:33.798784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:33.798784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:33.804877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:33.805323 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:33.806121 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:33.806553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:33.943958 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:33.952466 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:33.953971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:33.955336 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d51dae68-b657-4cf8-af6b-953cac580a71 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.161760 Dec 16 18:06:33.956298 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 700/1384] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:33 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:34.974491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:34.975097 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:34.982041 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:34.982544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:34.983477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:34.984035 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:35.127227 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:35.135579 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:35.137369 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:35.138540 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-9bef2710-f11b-46a2-aa68-d397fa89b9cb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.167996 Dec 16 18:06:35.139380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 685/1385] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:34 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:36.158688 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:36.159489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:36.167193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:36.168550 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:36.169699 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:36.170160 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:36.328494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:36.338656 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:36.341195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:36.342900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0300e790-5eb0-4b1c-a11c-e7392c910351 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.188700 Dec 16 18:06:36.344404 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 701/1386] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:36 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:37.362043 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:37.362683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:37.369131 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:37.369547 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:37.370491 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:37.371076 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:37.516609 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:37.526314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:37.527870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:37.529018 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-3f3d8d46-4557-4f89-9f05-2505f0edbe4c tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.171203 Dec 16 18:06:37.529622 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 686/1387] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:37 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:38.547880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:38.548524 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:38.555278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:38.555727 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:38.556508 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:38.556938 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:38.704229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:38.714423 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:38.716096 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:38.717823 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-38e04b50-0a82-487e-bd46-786a72617b64 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.173621 Dec 16 18:06:38.725296 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 702/1388] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:38 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:39.736582 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:39.737316 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:39.746140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:39.746703 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:39.747527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:39.748140 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:39.898247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:39.907191 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:39.908700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:39.909987 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-dfac0430-9e95-4e48-8d32-8a5c9ca9d0f5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.177173 Dec 16 18:06:39.910664 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 687/1389] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:39 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:40.929906 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:40.930777 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:40.938139 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:40.938594 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:40.939410 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:40.939844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:41.090143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:41.101580 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:41.103123 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:41.104295 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-02d4a204-0b29-4369-84bd-07317ed8b4c8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.178617 Dec 16 18:06:41.104981 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 703/1390] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:40 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:42.129022 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:42.129994 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:42.139054 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:42.139511 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:42.140301 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:42.140735 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:42.285836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:42.300641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:42.302133 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:42.303503 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-83a91740-8c8f-4d4e-b9a5-953b1ca992f1 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.180822 Dec 16 18:06:42.304092 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 688/1391] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:42 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:43.328622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:43.329235 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:43.336306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:43.336764 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:43.337552 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:43.337971 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:43.486195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:43.499784 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:43.502135 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:43.503875 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c6994b15-ad39-4a7b-ae89-1e51e1b8a484 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.179234 Dec 16 18:06:43.504520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 704/1392] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:43 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:44.526091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:44.526687 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:44.533956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:44.534380 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:44.535224 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:44.535681 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:44.685499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:44.697210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:44.699480 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:44.701128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-56e2b829-00c1-4274-a3be-26196469c95a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.179013 Dec 16 18:06:44.701884 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 689/1393] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:44 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:45.719890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:45.720504 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:45.727346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:45.728585 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:45.729827 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:45.730539 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:45.949074 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:45.957564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:45.959085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:45.960602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5d56444d-394c-4e0e-9194-d0880094ff3a tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.244555 Dec 16 18:06:45.961167 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 705/1394] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:45 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:46.979127 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:46.979775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:46.986778 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:46.987226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:46.988012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:46.988455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:47.125185 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:47.133431 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:47.134967 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:47.136132 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a3baad34-6e73-4e26-b369-3f1263b1a5f3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.161082 Dec 16 18:06:47.136688 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 690/1395] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:46 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:48.155061 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:48.155696 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:48.162429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:48.162901 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:48.163672 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:48.164099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:48.310237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:48.318952 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:48.320443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:48.321636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-327bc2cd-590f-45c0-b6a2-fcb8bec48203 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.170364 Dec 16 18:06:48.322204 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 706/1396] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:48 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:49.342529 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:49.343218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:49.351580 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:49.352032 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:49.352836 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:49.353269 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:49.513691 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:49.524220 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:49.525727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:49.526938 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a2e74462-fac1-4eba-8b56-6ab96a1140d3 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.188597 Dec 16 18:06:49.527720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 691/1397] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:49 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:50.550905 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:50.551792 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:50.561633 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:50.562364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:50.563180 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:50.563606 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:50.718864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:50.728364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:50.729872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:50.731076 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c95e1f2b-331a-4f85-8e3c-9efa549abca8 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.187121 Dec 16 18:06:50.731610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 707/1398] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:50 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:51.750946 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:51.751510 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:51.760402 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:51.760814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:51.761604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:51.762037 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:51.900257 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:51.909552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:51.911093 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:51.912253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2c212042-b0ea-4f2c-adce-fe6eb20b17d9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.165967 Dec 16 18:06:51.912826 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 692/1399] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:51 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:52.930013 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:52.930641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:52.937141 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:52.937583 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:52.938354 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:52.938814 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:53.080572 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:53.089371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:53.090909 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:53.092088 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-69620207-9d47-477b-ae43-711c83fae3bd tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.165924 Dec 16 18:06:53.092630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 708/1400] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:52 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:54.112478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:54.113122 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:54.119991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:54.120464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:54.121324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:54.121693 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:54.269917 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:54.278807 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:54.280298 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:54.281544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-695f2598-8ce0-4a6f-9bae-1c961dae2f3f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.173096 Dec 16 18:06:54.282136 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 693/1401] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:54 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:54.843313 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-95d5d6e7-3262-4111-a747-341df5255759 req-85fec8d3-7701-4676-89ae-55280a278a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "name": "network-vif-plugged", "status": "completed", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:06:54.844926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:06:54.844926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:06:54.852388 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-95d5d6e7-3262-4111-a747-341df5255759 req-85fec8d3-7701-4676-89ae-55280a278a47 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:54.852820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-95d5d6e7-3262-4111-a747-341df5255759 req-85fec8d3-7701-4676-89ae-55280a278a47 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:54.864622 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-95d5d6e7-3262-4111-a747-341df5255759 req-85fec8d3-7701-4676-89ae-55280a278a47 service nova] Creating event network-vif-plugged:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:06:54.869871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-95d5d6e7-3262-4111-a747-341df5255759 req-85fec8d3-7701-4676-89ae-55280a278a47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167044 Dec 16 18:06:54.870560 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 709/1402] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:06:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:06:55.302392 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:55.303044 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:55.309924 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:55.310370 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:55.311206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:55.311690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:55.462651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:55.472180 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:55.473661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:55.474870 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4451bdc1-40dc-45ac-875e-dae5af7011d0 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.176265 Dec 16 18:06:55.475468 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 694/1403] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:55 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:56.499467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:56.500290 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:56.506979 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:56.507428 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:56.508217 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:56.508650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:56.647391 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:56.655370 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:56.657494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:56.658659 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-e5e6e3ba-3d76-4ff5-b74e-5d5f36440ceb tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1729 microversion: 2.20 time: 0.166968 Dec 16 18:06:56.659239 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 710/1404] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:56 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:06:57.679823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:06:57.680546 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:06:57.690749 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:57.691344 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:57.692461 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:06:57.693060 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:06:57.833910 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:57.844953 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:57.846444 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:06:57.847641 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-fe5891af-2e9a-44b2-9f59-b1b1b9080afe tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1716 microversion: 2.20 time: 0.174031 Dec 16 18:06:57.848183 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 695/1405] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:06:57 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:07:53.573250 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:53.574237 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:53.581436 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.581885 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.582702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.583130 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.619495 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-a318be34-d8fb-4f9d-a4af-efed4f3b22c9 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050529 Dec 16 18:07:53.620403 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 711/1406] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Dec 16 18:07:53 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:07:53.684983 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:53.685597 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:53.692307 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.692744 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.693518 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.693947 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.720271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Going to try to terminate instance {{(pid=115915) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:07:53.809338 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-0991c097-559d-42e0-9af9-8da85c40d50f tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 204 len: 0 microversion: 2.20 time: 0.127770 Dec 16 18:07:53.810064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 696/1407] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Dec 16 18:07:53 2021] DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 18:07:53.818364 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:53.819008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:53.825541 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.826020 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.826850 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:53.827284 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:53.973050 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:53.981445 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:53.982989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:53.984156 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-53a7effd-32e6-4397-82e6-54dd94280381 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.169574 Dec 16 18:07:53.984724 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 712/1408] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:07:53 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:07:55.005443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:55.006333 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:55.014571 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:55.015073 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:55.015868 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:55.016314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:55.171217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:55.180014 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:55.181509 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:55.182959 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5fc32064-81e2-4a12-b720-9048ab22b1c7 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1722 microversion: 2.20 time: 0.182847 Dec 16 18:07:55.183775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 697/1409] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:07:54 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:07:56.201483 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:56.202185 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:56.209272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:56.209871 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:56.211018 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:56.211367 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:56.295157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:56.303900 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:56.305944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '634f9c0a59a94b4d8aad71ec93b6c11d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af23b4f4f497464fac434ca5b8be6ead', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:07:56.307199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-07cec691-8bd1-474d-a41c-01e0f329e18b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 200 len: 1655 microversion: 2.20 time: 0.109509 Dec 16 18:07:56.308159 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 713/1410] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:07:56 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 18:07:56.637907 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-b5bdfe33-29d4-46cf-9613-d95528948e58 req-3a35e163-a1be-4c13-99b0-8322d13d7fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3", "name": "network-vif-deleted", "tag": "725e8407-5a33-41d7-822b-8d87e05067a4"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:07:56.639613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:07:56.639613 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:07:56.647276 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b5bdfe33-29d4-46cf-9613-d95528948e58 req-3a35e163-a1be-4c13-99b0-8322d13d7fd3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:56.647720 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b5bdfe33-29d4-46cf-9613-d95528948e58 req-3a35e163-a1be-4c13-99b0-8322d13d7fd3 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:56.660353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-b5bdfe33-29d4-46cf-9613-d95528948e58 req-3a35e163-a1be-4c13-99b0-8322d13d7fd3 service nova] Creating event network-vif-deleted:725e8407-5a33-41d7-822b-8d87e05067a4 for instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 on hv-cinder-81920 Dec 16 18:07:56.665823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-b5bdfe33-29d4-46cf-9613-d95528948e58 req-3a35e163-a1be-4c13-99b0-8322d13d7fd3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189718 Dec 16 18:07:56.669539 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 698/1411] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:07:57.327059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:57.327671 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:57.334902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:57.335346 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:57.336191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:57.336618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:57.351084 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. Dec 16 18:07:57.351685 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:07:57.352519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-7c1c7481-0b2c-41e1-a9c7-412384a42d95 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 404 len: 111 microversion: 2.20 time: 0.030253 Dec 16 18:07:57.353053 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 714/1412] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:07:57 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:07:57.362464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-98f67349-ae12-4a97-ad38-3761ce0fc857 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '.version_select at 0x7fca1c29f3a0>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:57.383970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-98f67349-ae12-4a97-ad38-3761ce0fc857 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249433358" status: 204 len: 0 microversion: 2.20 time: 0.025506 Dec 16 18:07:57.384654 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 699/1413] 10.222.0.32 () {60 vars in 1261 bytes} [Thu Dec 16 18:07:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249433358 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 18:07:59.205462 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:59.206007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:59.213450 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:59.213898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:59.214867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:59.215307 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:59.229533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. Dec 16 18:07:59.230513 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:07:59.231363 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-804c1633-eda0-44e2-b6d4-3cf251323652 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 404 len: 111 microversion: 2.20 time: 0.029687 Dec 16 18:07:59.231908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 715/1414] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Dec 16 18:07:59 2021] DELETE /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:07:59.240768 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:07:59.241532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:07:59.248309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:59.248755 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:59.249557 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:07:59.249972 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:07:59.264296 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. Dec 16 18:07:59.264890 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:07:59.265711 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-63548926-b150-411f-974f-9a5fedf8850b tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3" status: 404 len: 111 microversion: 2.20 time: 0.029233 Dec 16 18:07:59.267469 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 700/1415] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:07:59 2021] GET /compute/v2.1/servers/b5ba83b3-d099-4c5c-8122-3eb4f9cb60b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:08:00.409603 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:08:00.410163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:08:00.417440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:08:00.417922 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:08:00.418740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:08:00.419177 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:08:00.433293 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. Dec 16 18:08:00.433813 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:08:00.434641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-df99d6fa-0303-4dca-a3ec-73535d420af5 tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 404 len: 111 microversion: 2.20 time: 0.028964 Dec 16 18:08:00.438203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 716/1416] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Dec 16 18:08:00 2021] DELETE /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:08:00.443321 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:08:00.443937 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] [instance: 5f9dd6ae-7f47-4593-bf30-0df596f5046a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:08:00.451091 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:08:00.451600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:08:00.452327 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:08:00.452759 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:08:00.467409 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] HTTP exception thrown: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. Dec 16 18:08:00.467992 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] Returning 404 to user: Instance 5f9dd6ae-7f47-4593-bf30-0df596f5046a could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:08:00.468808 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-718e85e9-d9af-48a7-8830-02213313fade tempest-AttachVolumeShelveTestJSON-1039140976 tempest-AttachVolumeShelveTestJSON-1039140976-project] 10.222.0.32 "GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a" status: 404 len: 111 microversion: 2.20 time: 0.029255 Dec 16 18:08:00.469337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 701/1417] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Dec 16 18:08:00 2021] GET /compute/v2.1/servers/5f9dd6ae-7f47-4593-bf30-0df596f5046a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 18:08:35.845748 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:08:35.846394 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:08:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:08:47.274434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Action: 'create', calling method: .version_select at 0x7fca207754c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1688842160"}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:08:47.290932 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for project c0363bdeefbc4436897296eeed016e4b. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:08:47.294934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for user 926eb216c07740fd981833011745031b and project c0363bdeefbc4436897296eeed016e4b. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:08:47.399994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for project c0363bdeefbc4436897296eeed016e4b. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:08:47.403963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for user 926eb216c07740fd981833011745031b and project c0363bdeefbc4436897296eeed016e4b. Resources: {'key_pairs'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:08:47.418992 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ea84be2d-cc2f-4f2b-a671-9d681d1b4796 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.323870 Dec 16 18:08:47.419623 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 717/1418] 10.222.0.32 () {60 vars in 1157 bytes} [Thu Dec 16 18:08:47 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:11.165478 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1516610962", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1688842160", "security_groups": [{"name": "tempest-secgroup-smoke-278465515"}], "block_device_mapping_v2": [{"uuid": "8a31b45e-6f1d-476c-b9f5-5f081eceb245", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34227dbd-7f78-49eb-8b6b-4fa4ee1247af"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:09:11.298350 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] validate_networks() for [('34227dbd-7f78-49eb-8b6b-4fa4ee1247af', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:09:11.813465 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:09:11.813891 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:09:11.814364 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:09:11.814829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:09:11.815239 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:09:11.824694 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:11.825079 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:11.825900 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:11.826335 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:11.844266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:09:11.849001 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for user 926eb216c07740fd981833011745031b and project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:09:11.910467 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:09:11.912636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a31b45e-6f1d-476c-b9f5-5f081eceb245',volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:09:12.057769 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ceed84e5-3971-41ac-9179-4e4f46b1e0d7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.899181 Dec 16 18:09:12.058408 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 702/1419] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 18:09:11 2021] POST /compute/v2.1/servers => generated 405 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 18:09:12.069520 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-b6f61c03-2f6a-4324-82b1-2e044277fecb tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:12.070111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-b6f61c03-2f6a-4324-82b1-2e044277fecb tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:12.128494 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-b6f61c03-2f6a-4324-82b1-2e044277fecb tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:12.135452 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-b6f61c03-2f6a-4324-82b1-2e044277fecb tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1095 microversion: 2.1 time: 0.070348 Dec 16 18:09:12.136012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 718/1420] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:12 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:13.154912 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:13.155718 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:13.162775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:13.163189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:13.164009 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:13.164455 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:13.227945 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:13.236753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-afcd6159-222d-41f2-b31c-50fd1ed87e74 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1201 microversion: 2.1 time: 0.087377 Dec 16 18:09:13.237329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 703/1421] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:13 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:09:14.254365 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:14.255015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:14.261968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:14.262425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:14.263252 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:14.263741 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:14.499935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:14.507908 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-49cd0f4c-9c77-4735-831f-f5bf8a48c544 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.258210 Dec 16 18:09:14.508484 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 719/1422] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:14 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:14.884120 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-e0c9f7dc-f2b9-40c9-9e20-1d869513751b req-42a0b43a-f9ee-41f4-afad-1e293bb0e205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21398b3-0da1-4be3-8dbc-685eaf55f3cb", "tag": "244fa820-d586-4f44-896a-fa63156aeebd"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:09:14.887395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:09:14.887395 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:09:14.897599 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-e0c9f7dc-f2b9-40c9-9e20-1d869513751b req-42a0b43a-f9ee-41f4-afad-1e293bb0e205 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:14.899098 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-e0c9f7dc-f2b9-40c9-9e20-1d869513751b req-42a0b43a-f9ee-41f4-afad-1e293bb0e205 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:14.912164 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-e0c9f7dc-f2b9-40c9-9e20-1d869513751b req-42a0b43a-f9ee-41f4-afad-1e293bb0e205 service nova] Creating event network-changed:244fa820-d586-4f44-896a-fa63156aeebd for instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb on hv-cinder-81920 Dec 16 18:09:14.917567 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-e0c9f7dc-f2b9-40c9-9e20-1d869513751b req-42a0b43a-f9ee-41f4-afad-1e293bb0e205 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040032 Dec 16 18:09:14.918142 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 704/1423] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:09:15.525012 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:15.525862 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:15.534025 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:15.534467 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:15.535282 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:15.535708 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:15.737628 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:15.745488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-27f4028c-6a52-4fd8-9378-5a4e52b69c7e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.224277 Dec 16 18:09:15.746113 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 720/1424] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:15 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:16.764507 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:16.765362 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:16.772578 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:16.773021 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:16.773809 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:16.774240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:16.929177 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:16.939956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-77de6c0f-eae2-41e3-82ce-f121b556fff3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.180041 Dec 16 18:09:16.942205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 705/1425] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:16 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:17.962379 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:17.963024 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:17.972418 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:17.972864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:17.974032 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:17.974797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:18.129563 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:18.137679 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1cdf6c59-479f-49ae-be2c-78ff172b384f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.179300 Dec 16 18:09:18.138311 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 721/1426] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:17 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:19.157724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:19.158332 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:19.165277 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:19.165725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:19.166496 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:19.166954 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:19.319788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:19.333111 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d5fb8fba-885d-4348-8c3a-2cbb9aa48832 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.180331 Dec 16 18:09:19.333776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 706/1427] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:19 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:20.351865 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:20.352522 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:20.360916 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:20.361387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:20.362231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:20.362734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:20.515369 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:20.523636 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-92673a35-1993-4c0b-a834-2e88cd5c085e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.177276 Dec 16 18:09:20.524215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 722/1428] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:20 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:21.544929 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:21.545940 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:21.556353 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:21.557036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:21.558240 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:21.558964 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:21.713312 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:21.721377 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-6260b18f-cb18-4925-aa21-cb4e8504fa8a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.182295 Dec 16 18:09:21.722215 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 707/1429] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:21 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:22.742151 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:22.743115 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:22.753756 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:22.754811 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:22.756163 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:22.757222 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:22.906761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:22.915339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c07aa999-1638-4d30-b8de-74df73eb8977 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.179595 Dec 16 18:09:22.915880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 723/1430] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:22 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:23.935154 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:23.936324 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:23.945443 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:23.945896 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:23.946752 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:23.947189 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:24.089895 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:24.097632 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b7830190-0309-4b15-bb96-d89fbf5a2986 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.168030 Dec 16 18:09:24.098397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 708/1431] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:23 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:25.114764 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:25.115327 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:25.122131 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:25.122574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:25.123401 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:25.123834 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:25.286434 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:25.294565 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0d68ef72-bdb1-4b6a-b0d8-c8d91a0f5307 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.184150 Dec 16 18:09:25.295497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 724/1432] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:25 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:25.370121 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-38c9e14f-2b00-4969-bed9-49fa1799c516 req-38e5f887-22d0-4796-bb70-ccacb9b8c8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21398b3-0da1-4be3-8dbc-685eaf55f3cb", "name": "network-vif-plugged", "status": "completed", "tag": "244fa820-d586-4f44-896a-fa63156aeebd"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:09:25.371857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:09:25.371857 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:09:25.381477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-38c9e14f-2b00-4969-bed9-49fa1799c516 req-38e5f887-22d0-4796-bb70-ccacb9b8c8e7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:25.381916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-38c9e14f-2b00-4969-bed9-49fa1799c516 req-38e5f887-22d0-4796-bb70-ccacb9b8c8e7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:25.398047 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-38c9e14f-2b00-4969-bed9-49fa1799c516 req-38e5f887-22d0-4796-bb70-ccacb9b8c8e7 service nova] Creating event network-vif-plugged:244fa820-d586-4f44-896a-fa63156aeebd for instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb on hv-cinder-81920 Dec 16 18:09:25.403477 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-38c9e14f-2b00-4969-bed9-49fa1799c516 req-38e5f887-22d0-4796-bb70-ccacb9b8c8e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037002 Dec 16 18:09:25.404323 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 709/1433] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:09:26.312306 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:26.312918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:26.319930 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:26.320368 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:26.321193 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:26.321619 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:26.465945 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:26.473779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0b3c9165-4776-4a6b-9c76-5e3a4e7b704b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1266 microversion: 2.1 time: 0.165125 Dec 16 18:09:26.474352 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 725/1434] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:26 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:27.492750 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:27.493405 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:27.500315 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:27.500770 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:27.501644 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:27.502287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:27.637715 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:27.645539 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-87b1e1fc-c0ac-4b66-9ec6-45d44a6d06b8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1454 microversion: 2.1 time: 0.157431 Dec 16 18:09:27.646102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 710/1435] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:27 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:27.661769 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:09:27.662383 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:09:27.669191 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:27.669673 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:27.670451 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:27.670915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:27.810574 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:09:27.818650 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-00b686ae-d1f4-4568-95fc-310312a262ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1454 microversion: 2.1 time: 0.160896 Dec 16 18:09:27.819236 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 726/1436] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:09:27 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:09:29.556921 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-1fcfaf09-5408-4324-8cea-9ffc655cccfd req-a79ebe2b-5ac8-44a5-b209-96b3dc501fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21398b3-0da1-4be3-8dbc-685eaf55f3cb", "tag": "244fa820-d586-4f44-896a-fa63156aeebd"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:09:29.558492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:09:29.558492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:09:29.567010 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1fcfaf09-5408-4324-8cea-9ffc655cccfd req-a79ebe2b-5ac8-44a5-b209-96b3dc501fc4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:09:29.567448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-1fcfaf09-5408-4324-8cea-9ffc655cccfd req-a79ebe2b-5ac8-44a5-b209-96b3dc501fc4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:09:29.578492 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-1fcfaf09-5408-4324-8cea-9ffc655cccfd req-a79ebe2b-5ac8-44a5-b209-96b3dc501fc4 service nova] Creating event network-changed:244fa820-d586-4f44-896a-fa63156aeebd for instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb on hv-cinder-81920 Dec 16 18:09:29.584128 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-1fcfaf09-5408-4324-8cea-9ffc655cccfd req-a79ebe2b-5ac8-44a5-b209-96b3dc501fc4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031177 Dec 16 18:09:29.584709 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 711/1437] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:09:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:10:26.065050 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:10:26.065753 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:10:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:11:43.287519 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bb1179b-96ed-4499-81e9-c9f16491ffd1] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:11:43.291857 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:43.292454 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:43.300006 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:43.300537 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:43.301458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:43.301968 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:43.327820 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:11:43.393187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [6a013a21-59d7-43f0-b85b-7e11c3061bbf] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 18:11:44.307712 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bb1179b-96ed-4499-81e9-c9f16491ffd1] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43884. Dec 16 18:11:44.412864 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [6a013a21-59d7-43f0-b85b-7e11c3061bbf] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43886. Dec 16 18:11:44.436046 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-699d4065-8c00-47e8-bd0a-8f2099880faf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 204 len: 0 microversion: 2.1 time: 1.150920 Dec 16 18:11:44.437107 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 727/1438] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:11:43 2021] DELETE /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:11:44.443773 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcd2e19c-d8ed-42ef-bc17-8603045b729b] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 16 18:11:44.447991 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:44.448678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:44.455862 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:44.456537 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:44.457505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:44.458003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:44.702974 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:44.714573 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f7694d89-4662-4b60-b113-a25275b216c8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1578 microversion: 2.1 time: 0.273044 Dec 16 18:11:44.715152 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 712/1439] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:44 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1578 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:45.732734 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:45.733440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:45.740425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:45.740872 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:45.741668 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:45.742099 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:45.939206 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:45.947353 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-cf727478-0454-4b8d-a53b-02a54b8fa803 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1578 microversion: 2.1 time: 0.218679 Dec 16 18:11:45.947926 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 728/1440] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:45 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:46.969309 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:46.969952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:46.989890 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:46.990016 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:46.990748 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:46.991184 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:46.995029 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcd2e19c-d8ed-42ef-bc17-8603045b729b] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43902. Dec 16 18:11:47.039205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-7b35397d-d644-4977-912d-4e9db41ff242 req-4dda8ce2-e419-4ce0-8872-f86291b283b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21398b3-0da1-4be3-8dbc-685eaf55f3cb", "name": "network-vif-deleted", "tag": "244fa820-d586-4f44-896a-fa63156aeebd"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:11:47.040735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:11:47.040735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:11:47.051609 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-7b35397d-d644-4977-912d-4e9db41ff242 req-4dda8ce2-e419-4ce0-8872-f86291b283b7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:47.052148 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-7b35397d-d644-4977-912d-4e9db41ff242 req-4dda8ce2-e419-4ce0-8872-f86291b283b7 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:47.054698 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:47.063346 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-a780a031-66c1-4c35-be95-69aa340c1ace tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 200 len: 1511 microversion: 2.1 time: 0.097737 Dec 16 18:11:47.064456 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 713/1441] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:46 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:47.070083 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-7b35397d-d644-4977-912d-4e9db41ff242 req-4dda8ce2-e419-4ce0-8872-f86291b283b7 service nova] Creating event network-vif-deleted:244fa820-d586-4f44-896a-fa63156aeebd for instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb on hv-cinder-81920 Dec 16 18:11:47.077716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-7b35397d-d644-4977-912d-4e9db41ff242 req-4dda8ce2-e419-4ce0-8872-f86291b283b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Dec 16 18:11:47.078507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 729/1442] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:11:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:11:48.081340 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:48.081918 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:48.089375 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:48.089812 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:48.090611 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:48.091089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:48.107754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] HTTP exception thrown: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. Dec 16 18:11:48.108276 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Returning 404 to user: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:11:48.109119 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-03ecd092-ed09-4139-bb5c-4efabcb23962 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 404 len: 111 microversion: 2.1 time: 0.031935 Dec 16 18:11:48.109675 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 714/1443] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:48 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:11:48.157278 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1703379512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1688842160", "security_groups": [{"name": "tempest-secgroup-smoke-278465515"}], "block_device_mapping_v2": [{"uuid": "8a31b45e-6f1d-476c-b9f5-5f081eceb245", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34227dbd-7f78-49eb-8b6b-4fa4ee1247af"}]}} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:11:48.271735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.network.neutron [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] validate_networks() for [('34227dbd-7f78-49eb-8b6b-4fa4ee1247af', None, None, None, None, None)] {{(pid=115914) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:11:48.740851 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:11:48.741443 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image limits 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:11:48.742136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:11:48.742702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image pref 0:0:0 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:11:48.743309 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.virt.hardware [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:11:48.754143 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:48.754589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:48.755448 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:48.755877 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:48.772634 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:11:48.776859 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.quota [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for user 926eb216c07740fd981833011745031b and project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:11:48.836946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Going to run 1 instances... {{(pid=115914) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:11:48.839368 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a31b45e-6f1d-476c-b9f5-5f081eceb245',volume_size=None,volume_type=None)] {{(pid=115914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:11:48.964257 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [83dd2046-6309-4d8d-90bd-40290e96f7f1] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 18:11:49.982442 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [83dd2046-6309-4d8d-90bd-40290e96f7f1] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43928. Dec 16 18:11:49.987355 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-f1885245-0169-461d-bf29-a21d2eebf3a3 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.834760 Dec 16 18:11:49.988015 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 730/1444] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 18:11:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 18:11:49.998038 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-d128bca7-07e5-4551-937c-88abef42230c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:49.998821 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-d128bca7-07e5-4551-937c-88abef42230c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:50.063708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-d128bca7-07e5-4551-937c-88abef42230c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:50.071116 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-d128bca7-07e5-4551-937c-88abef42230c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1095 microversion: 2.1 time: 0.076780 Dec 16 18:11:50.071683 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 715/1445] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:49 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:51.090476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-40417f6b-18c0-4b7a-ba42-1985fac45365 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:51.091335 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-40417f6b-18c0-4b7a-ba42-1985fac45365 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:51.145600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-40417f6b-18c0-4b7a-ba42-1985fac45365 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:51.155340 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-40417f6b-18c0-4b7a-ba42-1985fac45365 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1095 microversion: 2.1 time: 0.069867 Dec 16 18:11:51.156059 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 731/1446] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:51 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:52.175732 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1561cd15-339e-482c-8ce9-65dce2582ded tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:52.176314 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1561cd15-339e-482c-8ce9-65dce2582ded tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:52.245740 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1561cd15-339e-482c-8ce9-65dce2582ded tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:52.252695 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1561cd15-339e-482c-8ce9-65dce2582ded tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1095 microversion: 2.1 time: 0.080657 Dec 16 18:11:52.253211 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 716/1447] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:52 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:53.272490 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ed892804-00b1-44bb-bfd5-1689d7209838 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:53.273753 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ed892804-00b1-44bb-bfd5-1689d7209838 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:53.331955 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ed892804-00b1-44bb-bfd5-1689d7209838 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:53.338767 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ed892804-00b1-44bb-bfd5-1689d7209838 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1095 microversion: 2.1 time: 0.073658 Dec 16 18:11:53.339698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 732/1448] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:53 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:54.356210 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:54.356850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:54.363850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:54.364308 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:54.365089 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:54.365531 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:54.429614 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:54.437470 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-e8b59e37-9e5c-4abf-8eba-9fb42234e574 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1145 microversion: 2.1 time: 0.085281 Dec 16 18:11:54.438036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 717/1449] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:54 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:11:55.459740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:55.460809 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:55.471882 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:55.472707 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:55.473953 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:55.474425 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:55.551954 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:55.560395 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d9b1cf9c-921a-46a1-9725-bb50738e5005 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1211 microversion: 2.1 time: 0.108756 Dec 16 18:11:55.561199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 733/1450] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:55 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:56.475842 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f399bec9-d530-4ccd-aec8-d23c34c105d8", "tag": "ab182329-7738-48c9-83a9-d6487e56945f"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:11:56.477764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:11:56.477764 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:11:56.487741 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:56.488252 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:56.515732 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] Creating event network-changed:ab182329-7738-48c9-83a9-d6487e56945f for instance f399bec9-d530-4ccd-aec8-d23c34c105d8 on hv-cinder-81920 Dec 16 18:11:56.519155 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: ERROR oslo.messaging._drivers.impl_rabbit [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] [d4cc5a5e-2632-4736-8952-c09eecbcf110] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 18:11:56.577596 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:56.578671 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:56.586030 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:56.586642 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:56.587554 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:56.588080 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:56.833229 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:56.842534 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-ad29e712-d254-4402-afd7-36162283fbf5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.268868 Dec 16 18:11:56.843147 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 734/1451] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:56 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:57.537415 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] [d4cc5a5e-2632-4736-8952-c09eecbcf110] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43962. Dec 16 18:11:57.542156 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-efc67bfa-b806-404a-b2de-ef0232b025f3 req-65257cfc-9ec4-43e8-a565-1b1349088845 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.070419 Dec 16 18:11:57.542847 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 718/1452] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:11:57.562504 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:11:57.562794 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:11:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:11:57.860188 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:57.860783 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:57.867041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:57.867631 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:57.868599 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:57.869031 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:58.101449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:58.109553 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-19f9594a-6ff8-4d1c-8a18-1aa0f0d535e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.253546 Dec 16 18:11:58.110105 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 735/1453] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:57 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:11:59.128337 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:11:59.129020 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:11:59.137975 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:59.138566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:59.139428 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:11:59.139948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:11:59.277406 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:11:59.285274 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-ff5b4ae5-c152-4233-86e5-60d1a9f4d273 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.161680 Dec 16 18:11:59.285841 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 719/1454] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:11:59 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:00.302569 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:00.303245 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:00.310856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:00.311331 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:00.312136 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:00.312581 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:00.452982 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:00.461228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-fbd290ae-cd0a-402a-855f-7edae760a4cf tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.162696 Dec 16 18:12:00.461844 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 736/1455] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:00 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:01.478166 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:01.478827 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:01.486266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:01.486747 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:01.487544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:01.487976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:01.629885 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:01.639259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-8c9d9ea3-8a35-4476-bd20-dcc3e59884b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.163870 Dec 16 18:12:01.639259 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 720/1456] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:01 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:02.655177 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:02.655779 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:02.662937 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:02.663387 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:02.664187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:02.664618 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:02.808713 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:02.818011 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-39704fa4-bfb5-4ac8-9074-cab8725b4358 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.166733 Dec 16 18:12:02.818602 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 737/1457] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:02 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:03.835556 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:03.836199 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:03.843146 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:03.843586 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:03.844376 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:03.844803 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:03.992433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:04.006446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7b6abc51-8e5c-43f8-a4c6-c09973353466 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.174447 Dec 16 18:12:04.007266 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 721/1458] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:03 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:05.023977 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:05.024613 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:05.031515 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:05.031962 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:05.032790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:05.033218 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:05.173216 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:05.181357 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-3db7bf4e-b422-4d6b-a77d-7471178e6b45 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.161234 Dec 16 18:12:05.181934 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 738/1459] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:05 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:06.168521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-3ea3fe77-0e34-43d1-b99b-ceddb6162aaa req-e7351654-61a3-42c7-9700-90aad49d8668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f399bec9-d530-4ccd-aec8-d23c34c105d8", "name": "network-vif-plugged", "status": "completed", "tag": "ab182329-7738-48c9-83a9-d6487e56945f"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:12:06.170379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:12:06.170379 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:12:06.177732 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3ea3fe77-0e34-43d1-b99b-ceddb6162aaa req-e7351654-61a3-42c7-9700-90aad49d8668 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:06.178168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-3ea3fe77-0e34-43d1-b99b-ceddb6162aaa req-e7351654-61a3-42c7-9700-90aad49d8668 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:06.190271 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-3ea3fe77-0e34-43d1-b99b-ceddb6162aaa req-e7351654-61a3-42c7-9700-90aad49d8668 service nova] Creating event network-vif-plugged:ab182329-7738-48c9-83a9-d6487e56945f for instance f399bec9-d530-4ccd-aec8-d23c34c105d8 on hv-cinder-81920 Dec 16 18:12:06.195562 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-3ea3fe77-0e34-43d1-b99b-ceddb6162aaa req-e7351654-61a3-42c7-9700-90aad49d8668 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097857 Dec 16 18:12:06.196434 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 722/1460] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:12:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:12:06.199665 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:06.200837 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:06.207578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:06.208017 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:06.208799 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:06.209226 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:06.358043 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:06.370066 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-5e08e372-74ec-4b88-9db0-e3de0c0c2559 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.174496 Dec 16 18:12:06.371231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 739/1461] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:06 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:12:07.392386 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:07.393109 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:07.400036 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:07.400499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:07.401288 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:07.401719 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:07.543552 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:07.552001 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-7198624e-2225-4434-80dc-40950fdc92a2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1266 microversion: 2.1 time: 0.164494 Dec 16 18:12:07.552587 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 723/1462] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:07 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:08.569072 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:08.569740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:08.576683 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:08.577134 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:08.577935 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:08.578372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:08.718853 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:08.727228 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-acc8b331-9e55-4e1c-a4f3-f816634ac7b6 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1453 microversion: 2.1 time: 0.161875 Dec 16 18:12:08.727774 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 740/1463] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:08 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:08.744042 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:12:08.744645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:12:08.751754 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:08.752194 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:08.753048 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:08.753499 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:08.905501 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:12:08.913678 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-1baaf6c3-e5a7-4720-bdd2-1a1a1467de2d tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1453 microversion: 2.1 time: 0.173897 Dec 16 18:12:08.914265 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 724/1464] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:12:08 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:12:11.157803 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-46e4cafa-89c7-4adf-a158-8c970ad42de9 req-85636d18-ad78-47e8-a071-de43e5821be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f399bec9-d530-4ccd-aec8-d23c34c105d8", "tag": "ab182329-7738-48c9-83a9-d6487e56945f"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:12:11.159480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:12:11.159480 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:12:11.167476 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-46e4cafa-89c7-4adf-a158-8c970ad42de9 req-85636d18-ad78-47e8-a071-de43e5821be2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:12:11.167917 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-46e4cafa-89c7-4adf-a158-8c970ad42de9 req-85636d18-ad78-47e8-a071-de43e5821be2 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:12:11.180608 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-46e4cafa-89c7-4adf-a158-8c970ad42de9 req-85636d18-ad78-47e8-a071-de43e5821be2 service nova] Creating event network-changed:ab182329-7738-48c9-83a9-d6487e56945f for instance f399bec9-d530-4ccd-aec8-d23c34c105d8 on hv-cinder-81920 Dec 16 18:12:11.186804 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-46e4cafa-89c7-4adf-a158-8c970ad42de9 req-85636d18-ad78-47e8-a071-de43e5821be2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090799 Dec 16 18:12:11.187729 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 741/1465] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:13:46.084690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:13:46.084690 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:13:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:13:51.649231 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:13:51.649887 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:13:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:14:11.373544 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-882865593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1688842160", "security_groups": [{"name": "tempest-secgroup-smoke-278465515"}], "block_device_mapping_v2": [{"uuid": "fde71055-9c39-4c0d-9cd0-8284fd34cacc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "34227dbd-7f78-49eb-8b6b-4fa4ee1247af"}]}} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:14:11.506814 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.network.neutron [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] validate_networks() for [('34227dbd-7f78-49eb-8b6b-4fa4ee1247af', None, None, None, None, None)] {{(pid=115915) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 16 18:14:12.042427 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 18:14:12.042892 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image limits 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 18:14:12.043413 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Flavor pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 18:14:12.043850 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Image pref 0:0:0 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 18:14:12.044268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.virt.hardware [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 18:14:12.053971 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:12.054425 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:12.055280 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:12.055716 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:12.072824 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:14:12.077961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.quota [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Getting quotas for user 926eb216c07740fd981833011745031b and project c0363bdeefbc4436897296eeed016e4b. Resources: {'instances', 'cores', 'ram'} {{(pid=115915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:14:12.135646 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Going to run 1 instances... {{(pid=115915) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 16 18:14:12.137831 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fde71055-9c39-4c0d-9cd0-8284fd34cacc',volume_size=None,volume_type=None)] {{(pid=115915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 16 18:14:12.268150 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-45227c4f-47ce-4a71-8fd5-5aafd29f9de2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.900393 Dec 16 18:14:12.268788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 725/1466] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Dec 16 18:14:11 2021] POST /compute/v2.1/servers => generated 405 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 18:14:12.277578 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bb1179b-96ed-4499-81e9-c9f16491ffd1] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 16 18:14:12.281893 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-48a0f81a-7505-4693-a521-846e86728d18 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:12.282686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-48a0f81a-7505-4693-a521-846e86728d18 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:12.338449 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-48a0f81a-7505-4693-a521-846e86728d18 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:12.345740 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-48a0f81a-7505-4693-a521-846e86728d18 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1094 microversion: 2.1 time: 0.070203 Dec 16 18:14:12.346540 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 742/1467] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:12 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 18:14:13.363527 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:13.364390 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:13.371583 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:13.372027 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:13.373102 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:13.373282 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:13.436051 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:13.443873 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-953ffdf0-bebc-402f-b259-88c6b30b3709 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1210 microversion: 2.1 time: 0.084585 Dec 16 18:14:13.451795 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 726/1468] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:13 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:14.461589 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:14.462878 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:14.481989 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:14.482285 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:14.482870 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:14.483297 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:14.512181 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bb1179b-96ed-4499-81e9-c9f16491ffd1] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 44114. Dec 16 18:14:14.702187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:14.710376 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1452c556-83c1-40ea-9b8d-d3d661c3f7d4 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.252465 Dec 16 18:14:14.720902 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 743/1469] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:14 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:14.870536 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-008cc89a-fd99-4677-91da-e1f7917ec77b req-8ac8fd7c-1cb3-4e6e-b016-fb144da146b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039634e9-ba41-4ea5-98b2-ce5ae01d1a4a", "tag": "185eff32-fa67-4f14-8d51-1eec149421f3"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:14:14.872566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:14:14.872566 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:14:14.879927 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-008cc89a-fd99-4677-91da-e1f7917ec77b req-8ac8fd7c-1cb3-4e6e-b016-fb144da146b4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:14.880550 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-008cc89a-fd99-4677-91da-e1f7917ec77b req-8ac8fd7c-1cb3-4e6e-b016-fb144da146b4 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:14.891904 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-008cc89a-fd99-4677-91da-e1f7917ec77b req-8ac8fd7c-1cb3-4e6e-b016-fb144da146b4 service nova] Creating event network-changed:185eff32-fa67-4f14-8d51-1eec149421f3 for instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a on hv-cinder-81920 Dec 16 18:14:14.897013 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-008cc89a-fd99-4677-91da-e1f7917ec77b req-8ac8fd7c-1cb3-4e6e-b016-fb144da146b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111718 Dec 16 18:14:14.897829 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 727/1470] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:14:15.730761 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:15.731890 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:15.742685 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:15.743507 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:15.744790 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:15.745503 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:15.892153 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:15.899726 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-1054924d-7143-40b9-a89d-4cc44802d086 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.175017 Dec 16 18:14:15.900301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 744/1471] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:15 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:16.920866 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:16.921956 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:16.931995 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:16.932651 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:16.933915 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:16.934661 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:17.083607 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:17.096727 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f3d99336-65fc-4c22-a640-004ad73ee5b0 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.183022 Dec 16 18:14:17.097626 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 728/1472] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:16 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:18.121007 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:18.121611 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:18.129600 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:18.130060 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:18.130866 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:18.131299 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:18.274667 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:18.284758 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-0ab4a07e-f384-4bc8-a046-df22f624b4c5 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.169721 Dec 16 18:14:18.285339 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 745/1473] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:18 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:19.304017 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:19.304668 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:19.311725 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:19.312256 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:19.313168 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:19.313757 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:19.458889 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:19.466952 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-5ab7ee77-c764-42c1-9e34-efd56f14eca2 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.166662 Dec 16 18:14:19.467500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 729/1474] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:19 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:20.488244 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:20.489371 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:20.500419 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:20.500856 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:20.501641 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:20.502075 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:20.661698 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:20.673487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6a2a3432-c7e9-44e7-937b-95061fcfdbb7 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.191545 Dec 16 18:14:20.674234 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 746/1475] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:20 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:21.696948 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:21.697585 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:21.707997 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:21.708636 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:21.709708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:21.710226 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:21.853059 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:21.862916 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-19f4a78b-ef04-45d6-8842-c2375423326f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.171308 Dec 16 18:14:21.863464 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 730/1476] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:21 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:22.880546 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:22.881389 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:22.887964 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:22.888472 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:22.889215 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:22.889651 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:23.028187 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:23.037898 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d9786b44-4afa-42a5-a64a-9e7bf6371512 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.162055 Dec 16 18:14:23.038440 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 747/1477] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:22 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:24.055801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:24.056403 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:24.063625 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:24.064064 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:24.064864 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:24.065287 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:24.210666 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:24.219057 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-b43030a4-7c45-4e0a-9f43-d7af8a2bffaa tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.166931 Dec 16 18:14:24.219603 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 731/1478] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:24 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:24.874497 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [req-124e1f1b-1492-40c8-bf10-55e4a5f64464 req-c8d67248-7fb1-4c6e-a2a0-3c9a455f260f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039634e9-ba41-4ea5-98b2-ce5ae01d1a4a", "name": "network-vif-plugged", "status": "completed", "tag": "185eff32-fa67-4f14-8d51-1eec149421f3"}]} {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:14:24.876429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:14:24.876429 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: warnings.warn(msg) Dec 16 18:14:24.885686 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-124e1f1b-1492-40c8-bf10-55e4a5f64464 req-c8d67248-7fb1-4c6e-a2a0-3c9a455f260f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:24.886124 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [req-124e1f1b-1492-40c8-bf10-55e4a5f64464 req-c8d67248-7fb1-4c6e-a2a0-3c9a455f260f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:24.899489 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.compute.server_external_events [req-124e1f1b-1492-40c8-bf10-55e4a5f64464 req-c8d67248-7fb1-4c6e-a2a0-3c9a455f260f service nova] Creating event network-vif-plugged:185eff32-fa67-4f14-8d51-1eec149421f3 for instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a on hv-cinder-81920 Dec 16 18:14:24.904735 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [req-124e1f1b-1492-40c8-bf10-55e4a5f64464 req-c8d67248-7fb1-4c6e-a2a0-3c9a455f260f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 Dec 16 18:14:24.905328 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 748/1479] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:14:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:14:25.244291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:25.245206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:25.253970 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:25.254420 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:25.255233 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:25.255700 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:25.412533 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:25.420543 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-21d154ca-912a-4d50-9896-7b0b2dc107e8 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.182490 Dec 16 18:14:25.421173 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 732/1480] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:25 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:26.438769 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:26.439344 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:26.446199 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:26.446664 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:26.447458 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:26.447880 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:26.592987 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:26.601377 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-be4b3187-77d1-4369-a207-dde1b70f0c0c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1265 microversion: 2.1 time: 0.167182 Dec 16 18:14:26.601984 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 749/1481] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:26 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:27.617849 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:27.618776 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:27.627699 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:27.628149 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:27.628961 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:27.629397 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:27.789247 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:27.798216 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-34819364-2efe-4f26-8a7a-813a47b3d088 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1453 microversion: 2.1 time: 0.184258 Dec 16 18:14:27.798844 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 733/1482] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:27 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:27.814308 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:14:27.814994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:14:27.823643 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:27.824085 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:27.824867 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:27.825301 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:27.979282 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:14:27.987511 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-df94dc99-dca2-437f-ac30-49a7b1435735 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1453 microversion: 2.1 time: 0.176994 Dec 16 18:14:27.988120 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 750/1483] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:14:27 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:14:30.041799 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-b8e7e6ea-5531-40bc-bf4c-515feb5b0588 req-2f2f594b-71eb-487a-9346-a7497352a768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039634e9-ba41-4ea5-98b2-ce5ae01d1a4a", "tag": "185eff32-fa67-4f14-8d51-1eec149421f3"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:14:30.043433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:14:30.043433 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:14:30.050801 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b8e7e6ea-5531-40bc-bf4c-515feb5b0588 req-2f2f594b-71eb-487a-9346-a7497352a768 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:14:30.051237 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-b8e7e6ea-5531-40bc-bf4c-515feb5b0588 req-2f2f594b-71eb-487a-9346-a7497352a768 service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:14:30.062630 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-b8e7e6ea-5531-40bc-bf4c-515feb5b0588 req-2f2f594b-71eb-487a-9346-a7497352a768 service nova] Creating event network-changed:185eff32-fa67-4f14-8d51-1eec149421f3 for instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a on hv-cinder-81920 Dec 16 18:14:30.067856 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-b8e7e6ea-5531-40bc-bf4c-515feb5b0588 req-2f2f594b-71eb-487a-9346-a7497352a768 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029621 Dec 16 18:14:30.068463 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 734/1484] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:14:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:16:22.650232 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dcd2e19c-d8ed-42ef-bc17-8603045b729b] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 16 18:16:22.654582 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:22.655095 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:22.655520 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-8709d60e-fde8-44e1-829f-2ddb8c1a1b2f req-f626d91b-ec6d-4cb2-b32e-9e95d2d57f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039634e9-ba41-4ea5-98b2-ce5ae01d1a4a", "tag": "185eff32-fa67-4f14-8d51-1eec149421f3"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:16:22.657218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:16:22.657218 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:16:22.662912 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:22.663464 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:22.664373 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:22.664763 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8709d60e-fde8-44e1-829f-2ddb8c1a1b2f req-f626d91b-ec6d-4cb2-b32e-9e95d2d57f7f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:22.664876 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:22.665471 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-8709d60e-fde8-44e1-829f-2ddb8c1a1b2f req-f626d91b-ec6d-4cb2-b32e-9e95d2d57f7f service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:22.683724 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-8709d60e-fde8-44e1-829f-2ddb8c1a1b2f req-f626d91b-ec6d-4cb2-b32e-9e95d2d57f7f service nova] Creating event network-changed:185eff32-fa67-4f14-8d51-1eec149421f3 for instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a on hv-cinder-81920 Dec 16 18:16:22.689745 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-8709d60e-fde8-44e1-829f-2ddb8c1a1b2f req-f626d91b-ec6d-4cb2-b32e-9e95d2d57f7f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041470 Dec 16 18:16:22.690665 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 735/1485] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 18:16:22.695771 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:16:22.788630 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-43008d1c-bdba-4574-ab74-38bae51ce70f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 204 len: 0 microversion: 2.1 time: 0.141795 Dec 16 18:16:22.789617 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 751/1486] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:16:22 2021] DELETE /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:16:22.798791 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:22.799818 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:22.806258 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:22.806728 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:22.807521 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:22.807950 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:22.961756 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:22.970908 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2b6d282b-a145-4499-803e-e08154f1d69f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1578 microversion: 2.1 time: 0.176906 Dec 16 18:16:22.971505 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 736/1487] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:22 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:23.995041 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:23.996312 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:24.007943 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:24.008711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:24.010203 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:24.010963 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:24.174157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:24.181892 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4a8e9a65-37a7-44e7-85b0-be94dcd8c16f tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1459 microversion: 2.1 time: 0.194725 Dec 16 18:16:24.182487 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 752/1488] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:23 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1459 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:24.996175 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-0f60db55-f273-4e49-a84d-b9150da898df req-48e5100b-be88-4b5b-bffb-9987740d42ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039634e9-ba41-4ea5-98b2-ce5ae01d1a4a", "name": "network-vif-deleted", "tag": "185eff32-fa67-4f14-8d51-1eec149421f3"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:16:24.997761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:16:24.997761 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:16:25.016008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-0f60db55-f273-4e49-a84d-b9150da898df req-48e5100b-be88-4b5b-bffb-9987740d42ff service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:25.016438 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-0f60db55-f273-4e49-a84d-b9150da898df req-48e5100b-be88-4b5b-bffb-9987740d42ff service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:25.027454 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] [dcd2e19c-d8ed-42ef-bc17-8603045b729b] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 44196. Dec 16 18:16:25.029329 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-0f60db55-f273-4e49-a84d-b9150da898df req-48e5100b-be88-4b5b-bffb-9987740d42ff service nova] Creating event network-vif-deleted:185eff32-fa67-4f14-8d51-1eec149421f3 for instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a on hv-cinder-81920 Dec 16 18:16:25.035381 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-0f60db55-f273-4e49-a84d-b9150da898df req-48e5100b-be88-4b5b-bffb-9987740d42ff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042860 Dec 16 18:16:25.036012 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 737/1489] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:16:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:16:25.203481 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:25.204240 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:25.211154 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:25.211610 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:25.212372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:25.212839 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:25.279157 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:25.288111 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-d7dc8a9a-598b-4a70-b70a-8fddcb578f37 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 200 len: 1225 microversion: 2.1 time: 0.089445 Dec 16 18:16:25.295145 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 753/1490] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:25 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:26.305374 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:26.305976 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:26.312868 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:26.313290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:26.314106 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:26.314645 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:26.328590 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] HTTP exception thrown: Instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a could not be found. Dec 16 18:16:26.329268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Returning 404 to user: Instance 039634e9-ba41-4ea5-98b2-ce5ae01d1a4a could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:16:26.330522 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-2c2bf222-2108-42a1-9e36-3179fec672ac tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a" status: 404 len: 111 microversion: 2.1 time: 0.029611 Dec 16 18:16:26.330796 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 738/1491] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:26 2021] GET /compute/v2.1/servers/039634e9-ba41-4ea5-98b2-ce5ae01d1a4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:16:29.526071 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:29.527104 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:29.528869 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-d4eada52-6003-4c4a-9f0e-4ec919da41d3 req-70519e03-f72e-443e-9a2f-48cdbb0efa6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f399bec9-d530-4ccd-aec8-d23c34c105d8", "tag": "ab182329-7738-48c9-83a9-d6487e56945f"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:16:29.530532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:16:29.530532 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:16:29.536195 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:29.536616 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:29.537564 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:29.538000 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:29.541279 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d4eada52-6003-4c4a-9f0e-4ec919da41d3 req-70519e03-f72e-443e-9a2f-48cdbb0efa6a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:29.541788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-d4eada52-6003-4c4a-9f0e-4ec919da41d3 req-70519e03-f72e-443e-9a2f-48cdbb0efa6a service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:29.554737 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-d4eada52-6003-4c4a-9f0e-4ec919da41d3 req-70519e03-f72e-443e-9a2f-48cdbb0efa6a service nova] Creating event network-changed:ab182329-7738-48c9-83a9-d6487e56945f for instance f399bec9-d530-4ccd-aec8-d23c34c105d8 on hv-cinder-81920 Dec 16 18:16:29.560788 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-d4eada52-6003-4c4a-9f0e-4ec919da41d3 req-70519e03-f72e-443e-9a2f-48cdbb0efa6a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035910 Dec 16 18:16:29.562001 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 739/1492] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:16:29.573528 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Going to try to terminate instance {{(pid=115914) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 16 18:16:29.660998 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-4fe6824b-9091-4018-bac3-90697cb31565 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 204 len: 0 microversion: 2.1 time: 0.138434 Dec 16 18:16:29.663768 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 754/1493] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:16:29 2021] DELETE /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 18:16:29.676008 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:29.677105 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:29.684205 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:29.684708 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:29.685530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:29.686002 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:29.875193 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.policy [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:29.891311 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-f35e95dd-0946-41aa-9e95-23bdf753485b tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1577 microversion: 2.1 time: 0.221386 Dec 16 18:16:29.894677 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 740/1494] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:29 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:30.916549 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:30.917292 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:30.924267 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:30.924711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:30.925509 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:30.925946 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:31.072062 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:31.080741 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-6294dd34-a935-43f3-bcdf-08c102d79e19 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1459 microversion: 2.1 time: 0.168374 Dec 16 18:16:31.081351 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 755/1495] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:30 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:31.894294 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [req-4c28c432-5617-4c98-933f-b025038b43a8 req-8e8d1eaa-0aec-4701-80b0-72a6095aec4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f399bec9-d530-4ccd-aec8-d23c34c105d8", "name": "network-vif-deleted", "tag": "ab182329-7738-48c9-83a9-d6487e56945f"}]} {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 18:16:31.896077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 18:16:31.896077 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: warnings.warn(msg) Dec 16 18:16:31.905949 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-4c28c432-5617-4c98-933f-b025038b43a8 req-8e8d1eaa-0aec-4701-80b0-72a6095aec4b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:31.906448 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [req-4c28c432-5617-4c98-933f-b025038b43a8 req-8e8d1eaa-0aec-4701-80b0-72a6095aec4b service nova] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:31.918506 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.compute.server_external_events [req-4c28c432-5617-4c98-933f-b025038b43a8 req-8e8d1eaa-0aec-4701-80b0-72a6095aec4b service nova] Creating event network-vif-deleted:ab182329-7738-48c9-83a9-d6487e56945f for instance f399bec9-d530-4ccd-aec8-d23c34c105d8 on hv-cinder-81920 Dec 16 18:16:31.925653 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [req-4c28c432-5617-4c98-933f-b025038b43a8 req-8e8d1eaa-0aec-4701-80b0-72a6095aec4b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Dec 16 18:16:31.926500 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 741/1496] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Dec 16 18:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 18:16:32.099533 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:32.100208 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:32.107078 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:32.107461 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:32.108272 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:32.108711 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:32.170994 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.policy [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926eb216c07740fd981833011745031b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0363bdeefbc4436897296eeed016e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 18:16:32.179808 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-aa219055-0182-43a4-9dd4-c16a42a71215 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 200 len: 1226 microversion: 2.1 time: 0.084562 Dec 16 18:16:32.180678 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 756/1497] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:32 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 18:16:33.198206 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:33.198940 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: f399bec9-d530-4ccd-aec8-d23c34c105d8] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:33.206823 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.207291 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:33.208088 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.208530 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:33.222286 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] HTTP exception thrown: Instance f399bec9-d530-4ccd-aec8-d23c34c105d8 could not be found. Dec 16 18:16:33.222914 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Returning 404 to user: Instance f399bec9-d530-4ccd-aec8-d23c34c105d8 could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:16:33.223735 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-83b82293-6c49-4ff4-8d28-d0603d82a55c tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8" status: 404 len: 111 microversion: 2.1 time: 0.029711 Dec 16 18:16:33.224290 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 742/1498] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:33 2021] GET /compute/v2.1/servers/f399bec9-d530-4ccd-aec8-d23c34c105d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:16:33.949854 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:33.950330 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.compute.api [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115914) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:33.958008 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.958488 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:33.959372 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.959744 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG oslo_concurrency.lockutils [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:33.974362 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.wsgi [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] HTTP exception thrown: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. Dec 16 18:16:33.975092 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Returning 404 to user: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. {{(pid=115914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:16:33.975923 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-c50d596c-86f4-4067-857b-694971abbf9a tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 404 len: 111 microversion: 2.1 time: 0.030415 Dec 16 18:16:33.976465 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 757/1499] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Dec 16 18:16:33 2021] DELETE /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:16:33.984779 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '>' {{(pid=115915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:33.985399 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.compute.api [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] [instance: b21398b3-0da1-4be3-8dbc-685eaf55f3cb] Fetching instance by UUID {{(pid=115915) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 16 18:16:33.992775 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.993225 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:33.994003 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 16 18:16:33.994437 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG oslo_concurrency.lockutils [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Lock "68a2b8e0-0513-40e2-83b8-2a65c2eb69c2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 16 18:16:34.010858 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.wsgi [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] HTTP exception thrown: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. Dec 16 18:16:34.011446 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: DEBUG nova.api.openstack.wsgi [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Returning 404 to user: Instance b21398b3-0da1-4be3-8dbc-685eaf55f3cb could not be found. {{(pid=115915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 16 18:16:34.012268 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO nova.api.openstack.requestlog [None req-4ff49c84-a214-4c2e-a657-2190c877338e tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb" status: 404 len: 111 microversion: 2.1 time: 0.031291 Dec 16 18:16:34.012798 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: [pid: 115915|app: 0|req: 743/1500] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Dec 16 18:16:33 2021] GET /compute/v2.1/servers/b21398b3-0da1-4be3-8dbc-685eaf55f3cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 18:16:35.300966 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: DEBUG nova.api.openstack.wsgi [None req-75282d5c-1c19-4d78-b4ee-bc1fd8ab9710 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] Calling method '.version_select at 0x7fca205e23a0>' {{(pid=115914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 18:16:35.332133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO nova.api.openstack.requestlog [None req-75282d5c-1c19-4d78-b4ee-bc1fd8ab9710 tempest-TestVolumeBootPattern-99593887 tempest-TestVolumeBootPattern-99593887-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1688842160" status: 202 len: 0 microversion: 2.1 time: 0.035348 Dec 16 18:16:35.332702 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: [pid: 115914|app: 0|req: 758/1501] 10.222.0.32 () {58 vars in 1262 bytes} [Thu Dec 16 18:16:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1688842160 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 18:16:55.870117 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:16:55.871133 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:16:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:16:57.588596 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:16:57.589217 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:16:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:17:06.103998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:17:06.103998 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:17:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:18:51.671944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:18:51.672811 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:18:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:18:54.040319 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:18:54.040918 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:18:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:20:15.888944 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:20:15.889716 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:20:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:20:17.609604 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:20:17.610253 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:20:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:20:26.122848 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:20:26.123421 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:20:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:22:11.690205 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:22:11.690915 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:22:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:22:14.059797 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:22:14.060752 dv-cinder-819200-2-iscsi devstack@n-api.service[115914]: Thu Dec 16 18:22:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 18:22:17.178600 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:22:17.179221 dv-cinder-819200-2-iscsi devstack@n-api.service[115915]: Thu Dec 16 18:22:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!